Mobile terminal and controlling method thereof

ABSTRACT

A mobile terminal and controlling method thereof are disclosed, by which various convenient functions including application management in association with such a wearable external device as a watch type mobile terminal and the like can be provided. The present invention includes a wireless communication unit, a touchscreen, and a controller, when the touchscreen is turned off, if a 1 st  touch is inputted to the touchscreen and a 2 nd  touch is then inputted to the touchscreen by maintaining the 1 st  touch, turning on the touchscreen and controlling information of at least one wearable device currently connected through the wireless communication unit to be displayed on the touchscreen.

Pursuant to 35 U.S.C. §119(a), this application claims the benefit ofearlier filing date and right of priority to Korean Application Nos.10-2014-0066255, filed on May 30, 2014, and 10-2014-0076455, filed onJun. 23, 2014, the contents of which are all hereby incorporated byreference herein in their entirety.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a mobile terminal, and moreparticularly, to a mobile terminal and controlling method thereof.Although the present invention is suitable for a wide scope ofapplications, it is particularly suitable for providing variousconvenient functions including application management in associationwith such a wearable external device as a watch type mobile terminal andthe like.

2. Discussion of the Related Art

Generally, terminals can be classified into mobile/portable terminalsand stationary terminals. The mobile terminals can be further classifiedinto handheld terminals and vehicle mount terminals according topossibility of user's direct portability.

As functions of the terminal are getting diversified, the terminal tendsto be implemented as a multimedia player provided with compositefunctions such as photographing of photos or videos, playback of musicor video files, game play, broadcast reception and the like for example.

To support and increase the terminal functions, it may be able toconsider the improvement of structural parts and/or software parts ofthe terminal.

Recently, such a mobile terminal as a smartphone and the like tends tobe linked to various kinds of wearable devices. A mobile terminal of awatch type can be taken as one example of a wearable device. However,the watch type mobile terminal just plays a role as a relay of aninput/output means for performing a prescribed function of a mobileterminal in part. Moreover, in order to install an application on awearable device or to synchronize application data with a mobileterminal, it is inconvenient for the mobile terminal to run a separateapplication for managing the wearable device.

Meanwhile, such display devices as digital advertising panels tend to beincreasingly installed. Yet, since such a display device shows a presetimage or information corresponding to a touch input only, the demand forthe display device to interwork with such a mobile terminal as awearable device and the like is rising.

SUMMARY OF THE INVENTION

Accordingly, the present invention is directed to a mobile terminal andcontrolling method thereof that substantially obviate one or moreproblems due to limitations and disadvantages of the related art.

One object of the present invention is to provide a mobile terminal andcontrolling method thereof, by which convenient functions can beprovided in a manner of being connected to a wearable device.

Particularly, the object of the present invention is to provide a mobileterminal and controlling method thereof, by which an application of awearable device can be managed in the mobile terminal more conveniently.

Another object of the present invention is to provide a mobile terminaland controlling method thereof, by which an event occurring in awearable device can be conveniently processed in the mobile terminal.

Further object of the present invention is to provide a display deviceand controlling method thereof, by which information of a mobileterminal can be managed more conveniently.

Another further object of the present invention is to provide a mobileterminal and controlling method thereof, by which information displayedon a display device can be shared.

Technical tasks obtainable from the present invention are non-limited bythe above-mentioned technical tasks. And, other unmentioned technicaltasks can be clearly understood from the following description by thosehaving ordinary skill in the technical field to which the presentinvention pertains.

Additional advantages, objects, and features of the invention will beset forth in part in the description which follows and in part willbecome apparent to those having ordinary skill in the art uponexamination of the following or may be learned from practice of theinvention. The objectives and other advantages of the invention may berealized and attained by the structure particularly pointed out in thewritten description and claims hereof as well as the appended drawings.

To achieve these objects and other advantages and in accordance with thepurpose of the invention, as embodied and broadly described herein, amobile terminal according to one embodiment of the present inventionincludes a wireless communication unit, a touchscreen, and a controller,when the touchscreen is turned off, if a 1^(st) touch is inputted to thetouchscreen and a 2^(nd) touch is then inputted to the touchscreen bymaintaining the 1^(st) touch, turning on the touchscreen and controllinginformation of at least one wearable device currently connected throughthe wireless communication unit to be displayed on the touchscreen.

In another aspect of the present invention, as embodied and broadlydescribed herein, a method of controlling a mobile terminal includes thesteps of when a touchscreen is turned off, inputting a 1^(st) touch tothe touchscreen, if a 2^(nd) touch is inputted to the touchscreen bymaintaining the 1^(st) touch, turning on the touchscreen, and displayinginformation of at least one wearable device currently connected to themobile terminal on the touchscreen.

In further aspect of the present invention, as embodied and broadlydescribed herein, a display device according to another embodiment ofthe present invention includes a wireless communication unit, atouchscreen, and a controller, if a 1^(st) touch is inputted to thetouchscreen and a 2^(nd) touch is then inputted by maintaining the1^(st) touch, controlling information of at least one wearable devicecurrently connected through the wireless communication unit to bedisplayed on the touchscreen.

In another further aspect of the present invention, as embodied andbroadly described herein, a method of controlling a display deviceaccording to another embodiment of the present invention includes thesteps of connecting the display device to at least one wearable devicethrough a wireless communication unit, inputting a 1^(st) touch to atouchscreen, and if a 2^(nd) touch is inputted by maintaining the 1^(st)touch, displaying information of at least one wearable device currentlyconnected the display device through the wireless communication unit onthe touchscreen.

Accordingly, the present invention provides the following effects and/oradvantages.

First of all, a mobile terminal is set to interwork with a wearabledevice, thereby providing various kinds of convenient functions.

Secondly, the present invention enables a convenient and intuitiveaccess to an environment capable of managing applications of a wearabledevice in various situations.

Thirdly, according to the present invention, an event occurring in awearable device is associatively processed in a mobile terminal througha situation recognition and gesture and informations acquired from aplurality of wearable devices can be managed in an integrated waythrough the mobile terminal.

Fourthly, according to the present invention, information of a mobileterminal connected to a display device can be managed by the displaydevice.

Fifthly, according to the present invention, information displayed on adisplay device is conveniently shared with a mobile terminal or can bedelivered to other terminals.

Effects obtainable from the present invention may be non-limited by theabove mentioned effect. And, other unmentioned effects can be clearlyunderstood from the following description by those having ordinary skillin the technical field to which the present invention pertains.

It is to be understood that both the foregoing general description andthe following detailed description of the present invention areexemplary and explanatory and are intended to provide furtherexplanation of the invention as claimed.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are included to provide a furtherunderstanding of the invention and are incorporated in and constitute apart of this application, illustrate embodiment(s) of the invention andtogether with the description serve to explain the principle of theinvention. In the drawings:

FIG. 1 is a block diagram of a mobile terminal according to oneembodiment of the present invention;

FIG. 2A and FIG. 2B are perspective diagrams of a mobile terminalaccording to one embodiment of the present invention in different views;

FIG. 3 is a perspective diagram of a watch type wearable device 200according to another embodiment of the present invention;

FIG. 4 is a flowchart for one example of a process for a mobile terminalto manage an application of a wearable device by entering an applicationmanagement mode according to one embodiment of the present invention;

FIGS. 5A to 5C are diagrams for one example of inputting a 1^(st) touchand a 2^(nd) touch in a mobile terminal according to one embodiment ofthe present invention;

FIGS. 6A to 6C are diagrams for another example of inputting a 1^(st)touch and a 2^(nd) touch in a mobile terminal according to oneembodiment of the present invention;

FIGS. 7A and 7B are diagrams for one example of a method of inputting acommand for displaying an information of a connected wearable device ona mobile terminal according to one embodiment of the present invention;

FIGS. 8A to 8C are diagrams for one example of a configuration ofdisplaying an information of a wearable device in accordance with a typeof the wearable device on a mobile terminal according to one embodimentof the present invention;

FIGS. 9A to 9B are diagrams for one example of a configuration ofdisplaying an information of a wearable device on a mobile terminalconnected to a plurality of wearable devices according to one embodimentof the present invention;

FIGS. 9C to 9E are diagrams for one example of a process for installingan application by selecting a prescribed wearable device from aplurality of wearable devices connected to a mobile terminal accordingto one embodiment of the present invention;

FIGS. 10A to 10G are diagrams for examples of installing an applicationinstalled on a mobile terminal on a wearable device connected to themobile terminal according to one embodiment of the present invention;

FIGS. 11A and 11B are diagrams for one example of a method of displayingpossibility in installing an application per wearable device in a mobileterminal according to one embodiment of the present invention;

FIGS. 12A to 12D are diagrams for one example of a process for selectinga prescribed wearable device from a plurality of wearable devicesconnected to a mobile terminal and then installing an applicationinstalled on the selected wearable device on the mobile terminalaccording to one embodiment of the present invention;

FIGS. 13A to 13D are diagrams for another example of a process forinstalling an application installed on a mobile terminal on a prescribedone of a plurality of wearable devices connected to the mobile terminalaccording to one embodiment of the present invention;

FIGS. 14A to 14C are diagrams for one example of a method of performingsynchronization of applications installed on a connected wearable devicein a mobile terminal according to one embodiment of the presentinvention;

FIGS. 15A to 15G are diagrams for examples of a method of checking anevent occurring in the course of wearing a wearable device in a mobileterminal according to another embodiment of the present invention;

FIGS. 16A to 16D are diagrams for one example of a method of displayingand utilizing data acquired from a plurality of wearable devicestogether in a mobile terminal according to another embodiment of thepresent invention;

FIGS. 17A to 17C are diagrams for one example of a method of checkingdata acquired from a wearable device according to another embodiment ofthe present invention;

FIGS. 18A to 18D are diagrams for one example of a method of checkingdata acquired from one wearable device in another wearable deviceaccording to another embodiment of the present invention;

FIG. 19 is a flowchart for one example of a process for performing alinked operation by connecting a wearable device and an external displaydevice to each other according to another embodiment of the presentinvention;

FIGS. 20A to 20D are diagrams for one example of a process forconnecting a wearable device and an external display device to eachother according to another embodiment of the present invention;

FIGS. 21A to 21D are diagrams for one example of a process fordisplaying information of a wearable device on an external displaydevice according to another embodiment of the present invention;

FIG. 22 is a diagram for one example of a method of inputting a commandfor displaying information of a connected wearable device on an externaldisplay device according to another embodiment of the present invention;

FIGS. 23A to 23C are diagrams for one example of a configuration thatinformation of a wearable device is displayed on an external displaydevice in accordance with a type of the wearable device according toanother embodiment of the present invention;

FIGS. 24A and 24B are diagrams for one example of a configuration thatinformation of a wearable device is displayed on an external displaydevice connected to a plurality of wearable devices according to anotherembodiment of the present invention;

FIGS. 24C to 24E is a diagram for one example of a process forinstalling an application on a prescribed wearable device selected froma plurality of wearable devices connected to an external display deviceaccording to another embodiment of the present invention;

FIGS. 25A to 25G are diagrams for one example of a process forinstalling an application, which is already installed on an externaldevice, on a wearable device connected to the external display deviceaccording to another embodiment of the present invention;

FIGS. 26A to 26D are diagrams for another example of a process forinstalling an application, which is already installed on a mobileterminal, on a prescribed one of wearable devices connected to anexternal display device according to another embodiment of the presentinvention;

FIGS. 27A to 27C are diagrams for one example of a process for updatinguse history of a wearable device through an external display deviceaccording to another embodiment of the present invention;

FIGS. 28A to 28D are diagrams for one example of a process for checkinginformation of a wearable device in an external display device and thenupdating a use history in accordance with the checked informationaccording to another embodiment of the present invention;

FIGS. 29A to 29D are diagrams for one example of a method of directlydisplaying a function executed in a wearable device on an externaldisplay device according to another embodiment of the present invention;

FIGS. 30A to 30D are diagrams for one example of a method of displayinga function executed in an external display device on a wearable deviceaccording to another embodiment of the present invention;

FIGS. 31A to 31D and FIGS. 32A to 32D are diagrams for one example of aprocess for transmitting information displayed on an external displaydevice to a wearable device according to another embodiment of thepresent invention;

FIGS. 33A and 33B are diagrams for one example of a method oftransmitting a coupon according to another embodiment of the presentinvention;

FIGS. 34A to 34F are diagrams for one example of a method oftransmitting a coupon to another device according to another embodimentof the present invention;

FIGS. 35A and 35B are diagrams for one example of a configuration ofdisplaying a visit history on an external display device according toanother embodiment of the present invention;

FIGS. 36A to 36D are diagrams for one example of a method of determiningwhether a wearable device is put on, which is applicable to embodimentsof the present invention; and

FIGS. 37A to 37C are diagrams for one example of a method of informing auser whether a wearable device is put on, which is applicable toembodiments of the present invention.

DETAILED DESCRIPTION OF THE INVENTION

Description will now be given in detail according to exemplaryembodiments disclosed herein, with reference to the accompanyingdrawings. For the sake of brief description with reference to thedrawings, the same or equivalent components may be provided with thesame reference numbers, and description thereof will not be repeated. Ingeneral, a suffix such as “module” and “unit” may be used to refer toelements or components. Use of such a suffix herein is merely intendedto facilitate description of the specification, and the suffix itself isnot intended to give any special meaning or function. In the presentdisclosure, that which is well-known to one of ordinary skill in therelevant art has generally been omitted for the sake of brevity. Theaccompanying drawings are used to help easily understand varioustechnical features and it should be understood that the embodimentspresented herein are not limited by the accompanying drawings. As such,the present disclosure should be construed to extend to any alterations,equivalents and substitutes in addition to those which are particularlyset out in the accompanying drawings.

Mobile terminals presented herein may be implemented using a variety ofdifferent types of terminals. Examples of such terminals includecellular phones, smart phones, user equipment, laptop computers, digitalbroadcast terminals, personal digital assistants (PDAs), portablemultimedia players (PMPs), navigators, portable computers (PCs), slatePCs, tablet PCs, ultra books, wearable devices (for example, smartwatches, smart glasses, head mounted displays (HMDs)), and the like.

By way of non-limiting example only, further description will be madewith reference to particular types of mobile terminals. However, suchteachings apply equally to other types of terminals, such as those typesnoted above. In addition, these teachings may also be applied tostationary terminals such as digital TV, desktop computers, and thelike.

Reference is now made to FIGS. 1-2B, where FIG. 1 is a block diagram ofa mobile terminal in accordance with the present disclosure, and FIGS.2A and 2B are conceptual views of one example of the mobile terminal,viewed from different directions.

According to the present invention, various functions are providedthrough linked operations between a mobile terminal and a wearabledevice. Therefore, a configuration of a watch type wearable device isdescribed as one example of a wearable device to which the presentinvention is applicable.

The mobile terminal 100 is shown having components such as a wirelesscommunication unit 110, an input unit 120, a sensing unit 140, an outputunit 150, an interface unit 160, a memory 170, a controller 180, and apower supply unit 190. It is understood that implementing all of theillustrated components is not a requirement, and that greater or fewercomponents may alternatively be implemented.

Referring now to FIG. 1, the mobile terminal 100 is shown havingwireless communication unit 110 configured with several commonlyimplemented components. For instance, the wireless communication unit110 typically includes one or more components which permit wirelesscommunication between the mobile terminal 100 and a wirelesscommunication system or network within which the mobile terminal islocated.

The wireless communication unit 110 typically includes one or moremodules which permit communications such as wireless communicationsbetween the mobile terminal 100 and a wireless communication system,communications between the mobile terminal 100 and another mobileterminal, communications between the mobile terminal 100 and an externalserver. Further, the wireless communication unit 110 typically includesone or more modules which connect the mobile terminal 100 to one or morenetworks. To facilitate such communications, the wireless communicationunit 110 includes one or more of a broadcast receiving module 111, amobile communication module 112, a wireless Internet module 113, ashort-range communication module 114, and a location information module115.

The input unit 120 includes a camera 121 for obtaining images or video,a microphone 122, which is one type of audio input device for inputtingan audio signal, and a user input unit 123 (for example, a touch key, apush key, a mechanical key, a soft key, and the like) for allowing auser to input information. Data (for example, audio, video, image, andthe like) is obtained by the input unit 120 and may be analyzed andprocessed by controller 180 according to device parameters, usercommands, and combinations thereof.

The sensing unit 140 is typically implemented using one or more sensorsconfigured to sense internal information of the mobile terminal, thesurrounding environment of the mobile terminal, user information, andthe like. For example, in FIG. 1, the sensing unit 140 is shown having aproximity sensor 141 and an illumination sensor 142.

If desired, the sensing unit 140 may alternatively or additionallyinclude other types of sensors or devices, such as a touch sensor, anacceleration sensor, a magnetic sensor, a G-sensor, a gyroscope sensor,a motion sensor, an RGB sensor, an infrared (IR) sensor, a finger scansensor, a ultrasonic sensor, an optical sensor (for example, camera121), a microphone 122, a battery gauge, an environment sensor (forexample, a barometer, a hygrometer, a thermometer, a radiation detectionsensor, a thermal sensor, and a gas sensor, among others), and achemical sensor (for example, an electronic nose, a health care sensor,a biometric sensor, and the like), to name a few. The mobile terminal100 may be configured to utilize information obtained from sensing unit140, and in particular, information obtained from one or more sensors ofthe sensing unit 140, and combinations thereof.

The output unit 150 is typically configured to output various types ofinformation, such as audio, video, tactile output, and the like. Theoutput unit 150 is shown having a display unit 151, an audio outputmodule 152, a haptic module 153, and an optical output module 154.

The display unit 151 may have an inter-layered structure or anintegrated structure with a touch sensor in order to facilitate a touchscreen. The touch screen may provide an output interface between themobile terminal 100 and a user, as well as function as the user inputunit 123 which provides an input interface between the mobile terminal100 and the user.

The interface unit 160 serves as an interface with various types ofexternal devices that can be coupled to the mobile terminal 100. Theinterface unit 160, for example, may include any of wired or wirelessports, external power supply ports, wired or wireless data ports, memorycard ports, ports for connecting a device having an identificationmodule, audio input/output (I/O) ports, video I/O ports, earphone ports,and the like. In some cases, the mobile terminal 100 may performassorted control functions associated with a connected external device,in response to the external device being connected to the interface unit160.

The memory 170 is typically implemented to store data to support variousfunctions or features of the mobile terminal 100. For instance, thememory 170 may be configured to store application programs executed inthe mobile terminal 100, data or instructions for operations of themobile terminal 100, and the like. Some of these application programsmay be downloaded from an external server via wireless communication.Other application programs may be installed within the mobile terminal100 at time of manufacturing or shipping, which is typically the casefor basic functions of the mobile terminal 100 (for example, receiving acall, placing a call, receiving a message, sending a message, and thelike). It is common for application programs to be stored in the memory170, installed in the mobile terminal 100, and executed by thecontroller 180 to perform an operation (or function) for the mobileterminal 100.

The controller 180 typically functions to control overall operation ofthe mobile terminal 100, in addition to the operations associated withthe application programs. The controller 180 may provide or processinformation or functions appropriate for a user by processing signals,data, information and the like, which are input or output by the variouscomponents depicted in FIG. 1A, or activating application programsstored in the memory 170. As one example, the controller 180 controlssome or all of the components illustrated in FIGS. 1-2B according to theexecution of an application program that have been stored in the memory170.

The power supply unit 190 can be configured to receive external power orprovide internal power in order to supply appropriate power required foroperating elements and components included in the mobile terminal 100.The power supply unit 190 may include a battery, and the battery may beconfigured to be embedded in the terminal body, or configured to bedetachable from the terminal body.

Referring still to FIG. 1, various components depicted in this figurewill now be described in more detail. Regarding the wirelesscommunication unit 110, the broadcast receiving module 111 is typicallyconfigured to receive a broadcast signal and/or broadcast associatedinformation from an external broadcast managing entity via a broadcastchannel. The broadcast channel may include a satellite channel, aterrestrial channel, or both. In some embodiments, two or more broadcastreceiving modules 111 may be utilized to facilitate simultaneouslyreceiving of two or more broadcast channels, or to support switchingamong broadcast channels.

The broadcast managing entity may be implemented using a server orsystem which generates and transmits a broadcast signal and/or broadcastassociated information, or a server which receives a pre-generatedbroadcast signal and/or broadcast associated information, and sends suchitems to the mobile terminal. The broadcast signal may be implementedusing any of a TV broadcast signal, a radio broadcast signal, a databroadcast signal, and combinations thereof, among others. The broadcastsignal in some cases may further include a data broadcast signalcombined with a TV or radio broadcast signal.

The broadcast signal may be encoded according to any of a variety oftechnical standards or broadcasting methods (for example, InternationalOrganization for Standardization (ISO), International ElectrotechnicalCommission (IEC), Digital Video Broadcast (DVB), Advanced TelevisionSystems Committee (ATSC), and the like) for transmission and receptionof digital broadcast signals. The broadcast receiving module 111 canreceive the digital broadcast signals using a method appropriate for thetransmission method utilized.

Examples of broadcast associated information may include informationassociated with a broadcast channel, a broadcast program, a broadcastevent, a broadcast service provider, or the like. The broadcastassociated information may also be provided via a mobile communicationnetwork, and in this case, received by the mobile communication module112.

The broadcast associated information may be implemented in variousformats. For instance, broadcast associated information may include anElectronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB),an Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld(DVB-H), and the like. Broadcast signals and/or broadcast associatedinformation received via the broadcast receiving module 111 may bestored in a suitable device, such as a memory 170.

The mobile communication module 112 can transmit and/or receive wirelesssignals to and from one or more network entities. Typical examples of anetwork entity include a base station, an external mobile terminal, aserver, and the like. Such network entities form part of a mobilecommunication network, which is constructed according to technicalstandards or communication methods for mobile communications (forexample, Global System for Mobile Communication (GSM), Code DivisionMulti Access (CDMA), CDMA2000(Code Division Multi Access 2000),EV-DO(Enhanced Voice-Data Optimized or Enhanced Voice-Data Only),Wideband CDMA (WCDMA), High Speed Downlink Packet access (HSDPA),HSUPA(High Speed Uplink Packet Access), Long Term Evolution (LTE),LTE-A(Long Term Evolution-Advanced), and the like). Examples of wirelesssignals transmitted and/or received via the mobile communication module112 include audio call signals, video (telephony) call signals, orvarious formats of data to support communication of text and multimediamessages.

The wireless Internet module 113 is configured to facilitate wirelessInternet access. This module may be internally or externally coupled tothe mobile terminal 100. The wireless Internet module 113 may transmitand/or receive wireless signals via communication networks according towireless Internet technologies.

Examples of such wireless Internet access include Wireless LAN (WLAN),Wireless Fidelity (Wi-Fi), Wi-Fi Direct, Digital Living Network Alliance(DLNA), Wireless Broadband (WiBro), Worldwide Interoperability forMicrowave Access (WiMAX), High Speed Downlink Packet Access (HSDPA),HSUPA(High Speed Uplink Packet Access), Long Term Evolution (LTE),LTE-A(Long Term Evolution-Advanced), and the like. The wireless Internetmodule 113 may transmit/receive data according to one or more of suchwireless Internet technologies, and other Internet technologies as well.

In some embodiments, when the wireless Internet access is implementedaccording to, for example, WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE,LTE-A and the like, as part of a mobile communication network, thewireless Internet module 113 performs such wireless Internet access. Assuch, the Internet module 113 may cooperate with, or function as, themobile communication module 112.

The short-range communication module 114 is configured to facilitateshort-range communications. Suitable technologies for implementing suchshort-range communications include BLUETOOTH™, Radio FrequencyIDentification (RFID), Infrared Data Association (IrDA), Ultra-WideBand(UWB), ZigBee, Near Field Communication (NFC), Wireless-Fidelity(Wi-Fi), Wi-Fi Direct, Wireless USB(Wireless Universal Serial Bus), andthe like. The short-range communication module 114 in general supportswireless communications between the mobile terminal 100 and a wirelesscommunication system, communications between the mobile terminal 100 andanother mobile terminal 100, or communications between the mobileterminal and a network where another mobile terminal 100 (or an externalserver) is located, via wireless area networks. One example of thewireless area networks is a wireless personal area networks.

In some embodiments, another mobile terminal (which may be configuredsimilarly to mobile terminal 100) may be a wearable device, for example,a smart watch, a smart glass or a head mounted display (HMD), which isable to exchange data with the mobile terminal 100 (or otherwisecooperate with the mobile terminal 100). The short-range communicationmodule 114 may sense or recognize the wearable device, and permitcommunication between the wearable device and the mobile terminal 100.In addition, when the sensed wearable device is a device which isauthenticated to communicate with the mobile terminal 100, thecontroller 180, for example, may cause transmission of data processed inthe mobile terminal 100 to the wearable device via the short-rangecommunication module 114. Hence, a user of the wearable device may usethe data processed in the mobile terminal 100 on the wearable device.For example, when a call is received in the mobile terminal 100, theuser may answer the call using the wearable device. Also, when a messageis received in the mobile terminal 100, the user can check the receivedmessage using the wearable device.

The location information module 115 is generally configured to detect,calculate, derive or otherwise identify a position of the mobileterminal. As an example, the location information module 115 includes aGlobal Position System (GPS) module, a Wi-Fi module, or both. Ifdesired, the location information module 115 may alternatively oradditionally function with any of the other modules of the wirelesscommunication unit 110 to obtain data related to the position of themobile terminal.

As one example, when the mobile terminal uses a GPS module, a positionof the mobile terminal may be acquired using a signal sent from a GPSsatellite. As another example, when the mobile terminal uses the Wi-Fimodule, a position of the mobile terminal can be acquired based oninformation related to a wireless access point (AP) which transmits orreceives a wireless signal to or from the Wi-Fi module.

The input unit 120 may be configured to permit various types of input tothe mobile terminal 120. Examples of such input include audio, image,video, data, and user input. Image and video input is often obtainedusing one or more cameras 121. Such cameras 121 may process image framesof still pictures or video obtained by image sensors in a video or imagecapture mode. The processed image frames can be displayed on the displayunit 151 or stored in memory 170. In some cases, the cameras 121 may bearranged in a matrix configuration to permit a plurality of imageshaving various angles or focal points to be input to the mobile terminal100. As another example, the cameras 121 may be located in astereoscopic arrangement to acquire left and right images forimplementing a stereoscopic image.

The microphone 122 is generally implemented to permit audio input to themobile terminal 100. The audio input can be processed in various mannersaccording to a function being executed in the mobile terminal 100. Ifdesired, the microphone 122 may include assorted noise removingalgorithms to remove unwanted noise generated in the course of receivingthe external audio.

The user input unit 123 is a component that permits input by a user.Such user input may enable the controller 180 to control operation ofthe mobile terminal 100. The user input unit 123 may include one or moreof a mechanical input element (for example, a key, a button located on afront and/or rear surface or a side surface of the mobile terminal 100,a dome switch, a jog wheel, a jog switch, and the like), or atouch-sensitive input, among others. As one example, the touch-sensitiveinput may be a virtual key or a soft key, which is displayed on a touchscreen through software processing, or a touch key which is located onthe mobile terminal at a location that is other than the touch screen.On the other hand, the virtual key or the visual key may be displayed onthe touch screen in various shapes, for example, graphic, text, icon,video, or a combination thereof.

The sensing unit 140 is generally configured to sense one or more ofinternal information of the mobile terminal, surrounding environmentinformation of the mobile terminal, user information, or the like. Thecontroller 180 generally cooperates with the sending unit 140 to controloperation of the mobile terminal 100 or execute data processing, afunction or an operation associated with an application programinstalled in the mobile terminal based on the sensing provided by thesensing unit 140. The sensing unit 140 may be implemented using any of avariety of sensors, some of which will now be described in more detail.

The proximity sensor 141 may include a sensor to sense presence orabsence of an object approaching a surface, or an object located near asurface, by using an electromagnetic field, infrared rays, or the likewithout a mechanical contact. The proximity sensor 141 may be arrangedat an inner region of the mobile terminal covered by the touch screen,or near the touch screen.

The proximity sensor 141, for example, may include any of a transmissivetype photoelectric sensor, a direct reflective type photoelectricsensor, a mirror reflective type photoelectric sensor, a high-frequencyoscillation proximity sensor, a capacitance type proximity sensor, amagnetic type proximity sensor, an infrared rays proximity sensor, andthe like. When the touch screen is implemented as a capacitance type,the proximity sensor 141 can sense proximity of a pointer relative tothe touch screen by changes of an electromagnetic field, which isresponsive to an approach of an object with conductivity. In this case,the touch screen (touch sensor) may also be categorized as a proximitysensor.

The term “proximity touch” will often be referred to herein to denotethe scenario in which a pointer is positioned to be proximate to thetouch screen without contacting the touch screen. The term “contacttouch” will often be referred to herein to denote the scenario in whicha pointer makes physical contact with the touch screen. For the positioncorresponding to the proximity touch of the pointer relative to thetouch screen, such position will correspond to a position where thepointer is perpendicular to the touch screen. The proximity sensor 141may sense proximity touch, and proximity touch patterns (for example,distance, direction, speed, time, position, moving status, and thelike).

In general, controller 180 processes data corresponding to proximitytouches and proximity touch patterns sensed by the proximity sensor 141,and cause output of visual information on the touch screen. In addition,the controller 180 can control the mobile terminal 100 to executedifferent operations or process different data according to whether atouch with respect to a point on the touch screen is either a proximitytouch or a contact touch.

A touch sensor can sense a touch applied to the touch screen, such asdisplay unit 151, using any of a variety of touch methods. Examples ofsuch touch methods include a resistive type, a capacitive type, aninfrared type, and a magnetic field type, among others.

As one example, the touch sensor may be configured to convert changes ofpressure applied to a specific part of the display unit 151, or convertcapacitance occurring at a specific part of the display unit 151, intoelectric input signals. The touch sensor may also be configured to sensenot only a touched position and a touched area, but also touch pressureand/or touch capacitance. A touch object is generally used to apply atouch input to the touch sensor. Examples of typical touch objectsinclude a finger, a touch pen, a stylus pen, a pointer, or the like.

When a touch input is sensed by a touch sensor, corresponding signalsmay be transmitted to a touch controller. The touch controller mayprocess the received signals, and then transmit corresponding data tothe controller 180. Accordingly, the controller 180 may sense whichregion of the display unit 151 has been touched. Here, the touchcontroller may be a component separate from the controller 180, thecontroller 180, and combinations thereof.

In some embodiments, the controller 180 may execute the same ordifferent controls according to a type of touch object that touches thetouch screen or a touch key provided in addition to the touch screen.Whether to execute the same or different control according to the objectwhich provides a touch input may be decided based on a current operatingstate of the mobile terminal 100 or a currently executed applicationprogram, for example.

The touch sensor and the proximity sensor may be implementedindividually, or in combination, to sense various types of touches. Suchtouches includes a short (or tap) touch, a long touch, a multi-touch, adrag touch, a flick touch, a pinch-in touch, a pinch-out touch, a swipetouch, a hovering touch, and the like.

If desired, an ultrasonic sensor may be implemented to recognizeposition information relating to a touch object using ultrasonic waves.The controller 180, for example, may calculate a position of a wavegeneration source based on information sensed by an illumination sensorand a plurality of ultrasonic sensors. Since light is much faster thanultrasonic waves, the time for which the light reaches the opticalsensor is much shorter than the time for which the ultrasonic wavereaches the ultrasonic sensor. The position of the wave generationsource may be calculated using this fact. For instance, the position ofthe wave generation source may be calculated using the time differencefrom the time that the ultrasonic wave reaches the sensor based on thelight as a reference signal.

The camera 121 typically includes at least one a camera sensor (CCD,CMOS etc.), a photo sensor (or image sensors), and a laser sensor.

Implementing the camera 121 with a laser sensor may allow detection of atouch of a physical object with respect to a 3D stereoscopic image. Thephoto sensor may be laminated on, or overlapped with, the displaydevice. The photo sensor may be configured to scan movement of thephysical object in proximity to the touch screen. In more detail, thephoto sensor may include photo diodes and transistors at rows andcolumns to scan content received at the photo sensor using an electricalsignal which changes according to the quantity of applied light. Namely,the photo sensor may calculate the coordinates of the physical objectaccording to variation of light to thus obtain position information ofthe physical object.

The display unit 151 is generally configured to output informationprocessed in the mobile terminal 100. For example, the display unit 151may display execution screen information of an application programexecuting at the mobile terminal 100 or user interface (UI) and graphicuser interface (GUI) information in response to the execution screeninformation.

In some embodiments, the display unit 151 may be implemented as astereoscopic display unit for displaying stereoscopic images. A typicalstereoscopic display unit may employ a stereoscopic display scheme suchas a stereoscopic scheme (a glass scheme), an auto-stereoscopic scheme(glassless scheme), a projection scheme (holographic scheme), or thelike.

In general, a 3D stereoscopic image may include a left image (e.g., aleft eye image) and a right image (e.g., a right eye image). Accordingto how left and right images are combined into a 3D stereoscopic image,a 3D stereoscopic imaging method can be divided into a top-down methodin which left and right images are located up and down in a frame, anL-to-R (left-to-right or side by side) method in which left and rightimages are located left and right in a frame, a checker board method inwhich fragments of left and right images are located in a tile form, aninterlaced method in which left and right images are alternately locatedby columns or rows, and a time sequential (or frame by frame) method inwhich left and right images are alternately displayed on a time basis.

Also, as for a 3D thumbnail image, a left image thumbnail and a rightimage thumbnail can be generated from a left image and a right image ofan original image frame, respectively, and then combined to generate asingle 3D thumbnail image. In general, the term “thumbnail” may be usedto refer to a reduced image or a reduced still image. A generated leftimage thumbnail and right image thumbnail may be displayed with ahorizontal distance difference there between by a depth corresponding tothe disparity between the left image and the right image on the screen,thereby providing a stereoscopic space sense.

A left image and a right image required for implementing a 3Dstereoscopic image may be displayed on the stereoscopic display unitusing a stereoscopic processing unit. The stereoscopic processing unitcan receive the 3D image and extract the left image and the right image,or can receive the 2D image and change it into a left image and a rightimage.

The audio output module 152 is generally configured to output audiodata. Such audio data may be obtained from any of a number of differentsources, such that the audio data may be received from the wirelesscommunication unit 110 or may have been stored in the memory 170. Theaudio data may be output during modes such as a signal reception mode, acall mode, a record mode, a voice recognition mode, a broadcastreception mode, and the like. The audio output module 152 can provideaudible output related to a particular function (e.g., a call signalreception sound, a message reception sound, etc.) performed by themobile terminal 100. The audio output module 152 may also be implementedas a receiver, a speaker, a buzzer, or the like.

A haptic module 153 can be configured to generate various tactileeffects that a user feels, perceive, or otherwise experience. A typicalexample of a tactile effect generated by the haptic module 153 isvibration. The strength, pattern and the like of the vibration generatedby the haptic module 153 can be controlled by user selection or settingby the controller. For example, the haptic module 153 may outputdifferent vibrations in a combining manner or a sequential manner.

Besides vibration, the haptic module 153 can generate various othertactile effects, including an effect by stimulation such as a pinarrangement vertically moving to contact skin, a spray force or suctionforce of air through a jet orifice or a suction opening, a touch to theskin, a contact of an electrode, electrostatic force, an effect byreproducing the sense of cold and warmth using an element that canabsorb or generate heat, and the like.

The haptic module 153 can also be implemented to allow the user to feela tactile effect through a muscle sensation such as the user's fingersor arm, as well as transferring the tactile effect through directcontact. Two or more haptic modules 153 may be provided according to theparticular configuration of the mobile terminal 100.

An optical output module 154 can output a signal for indicating an eventgeneration using light of a light source. Examples of events generatedin the mobile terminal 100 may include message reception, call signalreception, a missed call, an alarm, a schedule notice, an emailreception, information reception through an application, and the like.

A signal output by the optical output module 154 may be implemented insuch a manner that the mobile terminal emits monochromatic light orlight with a plurality of colors. The signal output may be terminated asthe mobile terminal senses that a user has checked the generated event,for example.

The interface unit 160 serves as an interface for external devices to beconnected with the mobile terminal 100. For example, the interface unit160 can receive data transmitted from an external device, receive powerto transfer to elements and components within the mobile terminal 100,or transmit internal data of the mobile terminal 100 to such externaldevice. The interface unit 160 may include wired or wireless headsetports, external power supply ports, wired or wireless data ports, memorycard ports, ports for connecting a device having an identificationmodule, audio input/output (I/O) ports, video I/O ports, earphone ports,or the like.

The identification module may be a chip that stores various informationfor authenticating authority of using the mobile terminal 100 and mayinclude a user identity module (UIM), a subscriber identity module(SIM), a universal subscriber identity module (USIM), and the like. Inaddition, the device having the identification module (also referred toherein as an “identifying device”) may take the form of a smart card.Accordingly, the identifying device can be connected with the terminal100 via the interface unit 160.

When the mobile terminal 100 is connected with an external cradle, theinterface unit 160 can serve as a passage to allow power from the cradleto be supplied to the mobile terminal 100 or may serve as a passage toallow various command signals input by the user from the cradle to betransferred to the mobile terminal there through. Various commandsignals or power input from the cradle may operate as signals forrecognizing that the mobile terminal is properly mounted on the cradle.

The memory 170 can store programs to support operations of thecontroller 180 and store input/output data (for example, phonebook,messages, still images, videos, etc.). The memory 170 may store datarelated to various patterns of vibrations and audio which are output inresponse to touch inputs on the touch screen.

The memory 170 may include one or more types of storage mediumsincluding a Flash memory, a hard disk, a solid state disk, a silicondisk, a multimedia card micro type, a card-type memory (e.g., SD or DXmemory, etc), a Random Access Memory (RAM), a Static Random AccessMemory (SRAM), a Read-Only Memory (ROM), an Electrically ErasableProgrammable Read-Only Memory (EEPROM), a Programmable Read-Only memory(PROM), a magnetic memory, a magnetic disk, an optical disk, and thelike. The mobile terminal 100 may also be operated in relation to anetwork storage device that performs the storage function of the memory170 over a network, such as the Internet.

The controller 180 may typically control the general operations of themobile terminal 100. For example, the controller 180 may set or releasea lock state for restricting a user from inputting a control commandwith respect to applications when a status of the mobile terminal meetsa preset condition.

The controller 180 can also perform the controlling and processingassociated with voice calls, data communications, video calls, and thelike, or perform pattern recognition processing to recognize ahandwriting input or a picture drawing input performed on the touchscreen as characters or images, respectively. In addition, thecontroller 180 can control one or a combination of those components inorder to implement various exemplary embodiments disclosed herein.

The power supply unit 190 receives external power or provide internalpower and supply the appropriate power required for operating respectiveelements and components included in the mobile terminal 100. The powersupply unit 190 may include a battery, which is typically rechargeableor be detachably coupled to the terminal body for charging.

The power supply unit 190 may include a connection port. The connectionport may be configured as one example of the interface unit 160 to whichan external charger for supplying power to recharge the battery iselectrically connected.

As another example, the power supply unit 190 may be configured torecharge the battery in a wireless manner without use of the connectionport. In this example, the power supply unit 190 can receive power,transferred from an external wireless power transmitter, using at leastone of an inductive coupling method which is based on magnetic inductionor a magnetic resonance coupling method which is based onelectromagnetic resonance.

Various embodiments described herein may be implemented in acomputer-readable medium, a machine-readable medium, or similar mediumusing, for example, software, hardware, or any combination thereof.

Referring now to FIGS. 2A and 2B, the mobile terminal 100 is describedwith reference to a bar-type terminal body. However, the mobile terminal100 may alternatively be implemented in any of a variety of differentconfigurations. Examples of such configurations include watch-type,clip-type, glasses-type, or as a folder-type, flip-type, slide-type,swing-type, and swivel-type in which two and more bodies are combinedwith each other in a relatively movable manner, and combinationsthereof. Discussion herein will often relate to a particular type ofmobile terminal (for example, bar-type, watch-type, glasses-type, andthe like). However, such teachings with regard to a particular type ofmobile terminal will generally apply to other types of mobile terminalsas well.

The mobile terminal 100 will generally include a case (for example,frame, housing, cover, and the like) forming the appearance of theterminal. In this embodiment, the case is formed using a front case 101and a rear case 102. Various electronic components are incorporated intoa space formed between the front case 101 and the rear case 102. Atleast one middle case may be additionally positioned between the frontcase 101 and the rear case 102.

The display unit 151 is shown located on the front side of the terminalbody to output information. As illustrated, a window 151 a of thedisplay unit 151 may be mounted to the front case 101 to form the frontsurface of the terminal body together with the front case 101.

In some embodiments, electronic components may also be mounted to therear case 102. Examples of such electronic components include adetachable battery 191, an identification module, a memory card, and thelike. Rear cover 103 is shown covering the electronic components, andthis cover may be detachably coupled to the rear case 102. Therefore,when the rear cover 103 is detached from the rear case 102, theelectronic components mounted to the rear case 102 are externallyexposed.

As illustrated, when the rear cover 103 is coupled to the rear case 102,a side surface of the rear case 102 is partially exposed. In some cases,upon the coupling, the rear case 102 may also be completely shielded bythe rear cover 103. In some embodiments, the rear cover 103 may includean opening for externally exposing a camera 121 b or an audio outputmodule 152 b.

The cases 101, 102, 103 may be formed by injection-molding syntheticresin or may be formed of a metal, for example, stainless steel (STS),aluminum (Al), titanium (Ti), or the like.

As an alternative to the example in which the plurality of cases form aninner space for accommodating components, the mobile terminal 100 may beconfigured such that one case forms the inner space. In this example, amobile terminal 100 having a uni-body is formed in such a manner thatsynthetic resin or metal extends from a side surface to a rear surface.

If desired, the mobile terminal 100 may include a waterproofing unit(not shown) for preventing introduction of water into the terminal body.For example, the waterproofing unit may include a waterproofing memberwhich is located between the window 151 a and the front case 101,between the front case 101 and the rear case 102, or between the rearcase 102 and the rear cover 103, to hermetically seal an inner spacewhen those cases are coupled.

FIGS. 2A and 2B depict certain components as arranged on the mobileterminal. However, it is to be understood that alternative arrangementsare possible and within the teachings of the instant disclosure. Somecomponents may be omitted or rearranged. For example, the firstmanipulation unit 123 a may be located on another surface of theterminal body, and the second audio output module 152 b may be locatedon the side surface of the terminal body.

The display unit 151 outputs information processed in the mobileterminal 100. The display unit 151 may be implemented using one or moresuitable display devices. Examples of such suitable display devicesinclude a liquid crystal display (LCD), a thin film transistor-liquidcrystal display (TFT-LCD), an organic light emitting diode (OLED), aflexible display, a 3-dimensional (3D) display, an e-ink display, andcombinations thereof.

The display unit 151 may be implemented using two display devices, whichcan implement the same or different display technology. For instance, aplurality of the display units 151 may be arranged on one side, eitherspaced apart from each other, or these devices may be integrated, orthese devices may be arranged on different surfaces.

The display unit 151 may also include a touch sensor which senses atouch input received at the display unit. When a touch is input to thedisplay unit 151, the touch sensor may be configured to sense this touchand the controller 180, for example, may generate a control command orother signal corresponding to the touch. The content which is input inthe touching manner may be a text or numerical value, or a menu itemwhich can be indicated or designated in various modes.

The touch sensor may be configured in a form of a film having a touchpattern, disposed between the window 151 a and a display on a rearsurface of the window 151 a, or a metal wire which is patterned directlyon the rear surface of the window 151 a. Alternatively, the touch sensormay be integrally formed with the display. For example, the touch sensormay be disposed on a substrate of the display or within the display.

The display unit 151 may also form a touch screen together with thetouch sensor. Here, the touch screen may serve as the user input unit123 (see FIG. 1). Therefore, the touch screen may replace at least someof the functions of the first manipulation unit 123 a.

The first audio output module 152 a may be implemented in the form of aspeaker to output voice audio, alarm sounds, multimedia audioreproduction, and the like.

The window 151 a of the display unit 151 will typically include anaperture to permit audio generated by the first audio output module 152a to pass. One alternative is to allow audio to be released along anassembly gap between the structural bodies (for example, a gap betweenthe window 151 a and the front case 101). In this case, a holeindependently formed to output audio sounds may not be seen or isotherwise hidden in terms of appearance, thereby further simplifying theappearance and manufacturing of the mobile terminal 100.

The optical output module 154 can be configured to output light forindicating an event generation. Examples of such events include amessage reception, a call signal reception, a missed call, an alarm, aschedule notice, an email reception, information reception through anapplication, and the like. When a user has checked a generated event,the controller can control the optical output unit 154 to stop the lightoutput.

The first camera 121 a can process image frames such as still or movingimages obtained by the image sensor in a capture mode or a video callmode. The processed image frames can then be displayed on the displayunit 151 or stored in the memory 170.

The first and second manipulation units 123 a and 123 b are examples ofthe user input unit 123, which may be manipulated by a user to provideinput to the mobile terminal 100. The first and second manipulationunits 123 a and 123 b may also be commonly referred to as a manipulatingportion, and may employ any tactile method that allows the user toperform manipulation such as touch, push, scroll, or the like. The firstand second manipulation units 123 a and 123 b may also employ anynon-tactile method that allows the user to perform manipulation such asproximity touch, hovering, or the like.

FIG. 2A illustrates the first manipulation unit 123 a as a touch key,but possible alternatives include a mechanical key, a push key, a touchkey, and combinations thereof.

Input received at the first and second manipulation units 123 a and 123b may be used in various ways. For example, the first manipulation unit123 a may be used by the user to provide an input to a menu, home key,cancel, search, or the like, and the second manipulation unit 123 b maybe used by the user to provide an input to control a volume level beingoutput from the first or second audio output modules 152 a or 152 b, toswitch to a touch recognition mode of the display unit 151, or the like.

As another example of the user input unit 123, a rear input unit (notshown) may be located on the rear surface of the terminal body. The rearinput unit can be manipulated by a user to provide input to the mobileterminal 100. The input may be used in a variety of different ways. Forexample, the rear input unit may be used by the user to provide an inputfor power on/off, start, end, scroll, control volume level being outputfrom the first or second audio output modules 152 a or 152 b, switch toa touch recognition mode of the display unit 151, and the like. The rearinput unit may be configured to permit touch input, a push input, orcombinations thereof.

The rear input unit may be located to overlap the display unit 151 ofthe front side in a thickness direction of the terminal body. As oneexample, the rear input unit may be located on an upper end portion ofthe rear side of the terminal body such that a user can easilymanipulate it using a forefinger when the user grabs the terminal bodywith one hand. Alternatively, the rear input unit can be positioned atmost any location of the rear side of the terminal body.

Embodiments that include the rear input unit may implement some or allof the functionality of the first manipulation unit 123 a in the rearinput unit. As such, in situations where the first manipulation unit 123a is omitted from the front side, the display unit 151 can have a largerscreen.

As a further alternative, the mobile terminal 100 may include a fingerscan sensor which scans a user's fingerprint. The controller 180 canthen use fingerprint information sensed by the finger scan sensor aspart of an authentication procedure. The finger scan sensor may also beinstalled in the display unit 151 or implemented in the user input unit123.

The microphone 122 is shown located at an end of the mobile terminal100, but other locations are possible. If desired, multiple microphonesmay be implemented, with such an arrangement permitting the receiving ofstereo sounds.

The interface unit 160 may serve as a path allowing the mobile terminal100 to interface with external devices. For example, the interface unit160 may include one or more of a connection terminal for connecting toanother device (for example, an earphone, an external speaker, or thelike), a port for near field communication (for example, an InfraredData Association (IrDA) port, a Bluetooth port, a wireless LAN port, andthe like), or a power supply terminal for supplying power to the mobileterminal 100. The interface unit 160 may be implemented in the form of asocket for accommodating an external card, such as SubscriberIdentification Module (SIM), User Identity Module (UIM), or a memorycard for information storage.

The second camera 121 b is shown located at the rear side of theterminal body and includes an image capturing direction that issubstantially opposite to the image capturing direction of the firstcamera unit 121 a. If desired, second camera 121 a may alternatively belocated at other locations, or made to be moveable, in order to have adifferent image capturing direction from that which is shown.

The second camera 121 b can include a plurality of lenses arranged alongat least one line. The plurality of lenses may also be arranged in amatrix configuration. The cameras may be referred to as an “arraycamera.” When the second camera 121 b is implemented as an array camera,images may be captured in various manners using the plurality of lensesand images with better qualities.

As shown in FIG. 2B, a flash 124 is shown adjacent to the second camera121 b. When an image of a subject is captured with the camera 121 b, theflash 124 may illuminate the subject.

As shown in FIG. 2A, the second audio output module 152 b can be locatedon the terminal body. The second audio output module 152 b may implementstereophonic sound functions in conjunction with the first audio outputmodule 152 a, and may be also used for implementing a speaker phone modefor call communication.

At least one antenna for wireless communication may be located on theterminal body. The antenna may be installed in the terminal body orformed by the case. For example, an antenna which configures a part ofthe broadcast receiving module 111 may be retractable into the terminalbody. Alternatively, an antenna may be formed using a film attached toan inner surface of the rear cover 103, or a case that includes aconductive material.

A power supply unit 190 for supplying power to the mobile terminal 100may include a battery 191, which is mounted in the terminal body ordetachably coupled to an outside of the terminal body. The battery 191may receive power via a power source cable connected to the interfaceunit 160. Also, the battery 191 can be recharged in a wireless mannerusing a wireless charger. Wireless charging may be implemented bymagnetic induction or electromagnetic resonance.

The rear cover 103 is shown coupled to the rear case 102 for shieldingthe battery 191, to prevent separation of the battery 191, and toprotect the battery 191 from an external impact or from foreignmaterial. When the battery 191 is detachable from the terminal body, therear case 103 may be detachably coupled to the rear case 102.

An accessory for protecting an appearance or assisting or extending thefunctions of the mobile terminal 100 can also be provided on the mobileterminal 100. As one example of an accessory, a cover or pouch forcovering or accommodating at least one surface of the mobile terminal100 may be provided. The cover or pouch may cooperate with the displayunit 151 to extend the function of the mobile terminal 100. Anotherexample of the accessory is a touch pen for assisting or extending atouch input to a touch screen.

FIG. 3 is a perspective view illustrating a watch-type mobile terminal200 as one example a wearable device in accordance with embodiments ofthe present invention. As illustrated in FIG. 3, the watch-type mobileterminal 200 includes a main body 201 with a display unit 251 and a band202 connected to the main body 201 to be wearable on a wrist.

The main body 201 may include a case having a certain appearance. Asillustrated, the case may include a first case 201 a and a second case201 b cooperatively defining an inner space for accommodating variouselectronic components. Other configurations are possible. For instance,a single case may alternatively be implemented, with such a case beingconfigured to define the inner space, thereby implementing a mobileterminal 200 with a uni-body. In this case, variouselectrical/electronic parts included in the case can be configured toperform at least the same or similar functions of the respectivecomponents described with reference to FIGS. 1-2B. For instance, acontroller is provided to a watch type mobile terminal. And, a wirelesscommunication unit, an interface unit, a memory and the like can befurther provided to the watch type mobile terminal if necessary.

The watch-type mobile terminal 200 can perform wireless communication,and an antenna for the wireless communication can be installed in themain body 201. The antenna may extend its function using the case. Forexample, a case including a conductive material may be electricallyconnected to the antenna to extend a ground area or a radiation area.

The display unit 251 is shown located at the front side of the main body201 so that displayed information is viewable to a user. In someembodiments, the display unit 251 includes a touch sensor so that thedisplay unit can function as a touch screen. As illustrated, window 251a is positioned on the first case 201 a to form a front surface of theterminal body together with the first case 201 a.

The illustrated embodiment includes audio output module 252, a camera221, a microphone 222, and a user input unit 223 positioned on the mainbody 201. When the display unit 251 is implemented as a touch screen,additional function keys may be minimized or eliminated. For example,when the touch screen is implemented, the user input unit 223 may beomitted.

The band 202 is commonly worn on the user's wrist and may be made of aflexible material for facilitating wearing of the device. As oneexample, the band 202 may be made of fur, rubber, silicon, syntheticresin, or the like. The band 202 may also be configured to be detachablefrom the main body 201. Accordingly, the band 202 may be replaceablewith various types of bands according to a user's preference.

In one configuration, the band 202 may be used for extending theperformance of the antenna. For example, the band may include therein aground extending portion (not shown) electrically connected to theantenna to extend a ground area.

The band 202 may include fastener 202 a. The fastener 202 a may beimplemented into a buckle type, a snap-fit hook structure, a Velcro®type, or the like, and include a flexible section or material. Thedrawing illustrates an example that the fastener 202 a is implementedusing a buckle.

Moreover, it is a matter of course that a wearable device of a watchtype is provided with a controller configured to control the respectivecomponents configuring the wearable device and to perform decision andprocessing on each function mentioned in the following description [notshown in the drawing]. Besides, the present invention is applicable towearable devices of various types including a bracelet type, a glassestype, a necklace type and the like as well as to a wearable device of awatch type. In this case, configurations of the components shown in FIG.3 can be modified to fit wearable shapes.

Assume that the mobile terminal 100 according to the present inventionincludes at least one of the components shown in FIGS. 1 to 2B. Inparticular, the mobile terminal 100 according to the present inventioncan be assumed as including the wireless communication unit 110, thesensing unit 140, the display unit 151 and the controller 180.

Meanwhile, such a graphic for pointing at a specific object on a displayunit or selecting a menu from the display unit as an arrow, a finger andthe like is called a pointer or a cursor. However, the pointer isfrequently used to mean a finger, a stylus pen or the like for a touchmanipulation and the like. In order to clearly discriminate the pointerand the cursor from each other in this disclosure, a graphic displayedon a display unit is named a cursor and such a physical means forperforming a touch, a proximity touch, a gesture and the like as afinger, a stylus pen and the like is named a pointer.

Moreover, a mobile terminal can perform a data exchange for performing alinked function, which will be described later, by being connected to awearable device through a short range communication (e.g., Bluetooth,etc.), a wireless internet, and the like. Each function mentioned in thefollowing description can be executed through at least one application.In particular, at least two applications can run together to execute asingle function or the corresponding function can be executed through asingle application.

Application Management of Wearable Device Through Mobile Terminal

According to one embodiment of the present invention, a mobile terminaland controlling method thereof are provided to facilitate management ofan application of a connected wearable device. Particularly, the presentembodiment proposes a method as follows. First of all, a separateapplication is run in order for a mobile terminal to manage anapplication of a wearable device for installation, informationsynchronization and the like. Secondly, a management job can be enteredconveniently and easily to avoid inconvenience in doing the managementjob through the running application. In particular, the presentembodiment proposes to enter a manageable mode (hereinafter called‘application management mode) of an application of a connected wearabledevice through a touch input of a specific type while a display of amobile terminal is turned off.

The above description is explained in detail with reference to FIG. 4 asfollows.

FIG. 4 is a flowchart for one example of a process for a mobile terminalto manage an application of a wearable device by entering an applicationmanagement mode according to one embodiment of the present invention.

In FIG. 4, assume a state that at least one wearable device is alreadyconnected to a mobile terminal. In particular, assume a case ofcompleting a data path establishment after finishing a prescribedinitial registration procedure. Of course, a case that a wearable deviceenters a standby/power saving mode (e.g., idle/sleep mode, etc.) forentering a data exchangeable state through a relatively simple procedurecan be included in a ‘connecting’ state mentioned in the presentinvention as well as a case that a data exchange is possible right afteran establishment of a data path.

Referring to FIG. 4, a display of the touchscreen 151 of the mobileterminal may be turned off [S410]. When the touchscreen 151 includes atouch sensor and a display, this may mean a state that an input of atouch with a pointer can be detected owing to an activated touch sensordespite that no images are displayed on a display. While the display isturned on due to one of various reasons (e.g., an alarm/communicationevent occurrence, a user's key button manipulation, etc.), if a powerkey button is manipulated, the controller can control the display to beturned off. After the display has been turned off, if there is no eventoccurrence or key button manipulation for prescribed duration, thecontroller can control the display to be turned off as well.

After the display has been turned off, while a 1^(st) touch to thetouchscreen is maintained instead of being cancelled, if a 2^(nd) touchis inputted [S420], the controller 180 turns on the display and is alsoable to control at least one currently connected wearable device to bedisplayed in a prescribed form [S430]. In doing so, the 1^(st) touch canbe inputted to a random point on the touchscreen and the 2^(nd) touch ina predetermined pattern is preferably inputted to a point different fromthe 1^(st) touch inputted. In this case, the predetermined pattern ofthe 2^(nd) touch may be equal to or different from a pattern for turningon the touchscreen or cancelling a lock screen. If the predeterminedpattern of the 2^(nd) touch is different from the pattern for turning onthe touchscreen or cancelling the lock screen, it may be able toconsider omitting the 1^(st) touch. The currently connected wearabledevice can be displayed as a list. The currently connected wearabledevice can be displayed in a manner that a visual effect is given to thecorresponding wearable device to correspond to a shape of the wearabledevice. And, the currently connected wearable device can be displayedtogether with an application installed on the corresponding wearabledevice or a function executable through the installed application.Details of the wearable device shall be described later.

If a plurality of wearable devices are currently connected [S440], aprescribed wearable device desired for application management by a usercan be selected from a plurality of the currently connected wearabledevices through a 3^(rd) touch input [S450]. In case that a singlewearable device is currently connected, application management can beexecuted in direct [S460]. In this case, the application management caninclude a process for installing an application, which is installed on amobile terminal, on a currently connected wearable device, a process forinstalling an application, which is installed on a currently connectedwearable device, on a mobile terminal, and a process for installing anapplication, which is installed on one wearable device, on anotherwearable device. In case that the same application is installed on atleast two wearable devices currently connected to a mobile terminal,synchronization of application data can be included in the applicationmanagement of the present embodiment.

Generally, when a display is turned off, a connected wearable device canbe checked or application management can be performed in a manner ofturning on the display and then running a wearable device managementapplication in a home screen or an application list. Yet, in case thatthe display is turned off, it is able to check a currently connectedwearable device through a touch input in a preset pattern only by theaforementioned steps S410 to S430.

The application managing method described with reference to FIG. 4 isdescribed in detail with reference to FIGS. 5A to 5C as follows. In thefollowing descriptions, ‘a touchscreen is turned off’ means a state thata touch sensing function is working despite that a display function ofthe touchscreen is turned off.

FIGS. 5A to 5C are diagrams for one example of inputting a 1^(st) touchand a 2^(nd) touch in a mobile terminal according to one embodiment ofthe present invention.

As mentioned in the foregoing description, a predetermined pattern of a2^(nd) touch may be equal to or different from a pattern for turning ona touchscreen or cancelling a lock screen. And, the equal case isdescribed with reference to FIGS. 5A to 5C. Moreover, assume a case thata watch type wearable device is connected to a mobile terminal.

For instance, referring to FIG. 5A, while the touchscreen 151 is turnedoff, if the touchscreen 151 is knocked twice consecutively within aprescribed time using a pointer 510, the touchscreen 151 can be turnedon. Such a method of turning on a touchscreen shall be named ‘knock on’for clarity. On the other hand, while a touch contact (i.e., 1^(st)touch) with the touchscreen 151 is maintained using one pointer 520, ifthe touchscreen 151 is touched twice consecutively using another pointer510 [i.e., 2^(nd) touch] [FIG. 5B], the touchscreen 151 is turned on andinformation of a connected watch type wearable device can be displayedin a watch shape 530 [FIG. 5C]. Within the watch shape, the hands of awatch corresponding to a current time can be displayed. And, a pluralityof icons/indicators 531 can be displayed on dial edge of a watch. Eachof the icons or indicators may correspond to a single applicationinstalled on the wearable device or an application group including aplurality of applications and may indicate an operating status of thewearable device. Regarding the number of the icons/indicators, a presetnumber may be displayed only in order of recent use or in accordancewith a user-set priority. And, other icons/indicators may be displayedthrough a scroll. In the present specification, an icon/indicator isuniformly configured in a manner of displaying an alphabet in a circle.If an alphabet is different, a type of the icon/indicator is assumed asdifferent. If an alphabet is identical, a type of the icon/indicator isassumed as the same. This assumption is made for clarity of thedescription. And, it is apparent to those skilled in the art that thepresent invention is non-limited by a configuration and deploymentlocation of an icon/indicator. If information of a connected wearabledevice displayed through a 1^(st) or 2^(nd) touch is displayed tocorrespond to a shape of the corresponding device, it is displayed forfacilitation of visual device discrimination. Hence, it is unnecessaryfor the information to be displayed to correspond to the correspondingshape. Meanwhile, if a specific icon is selected, detailed information(e.g., size, source, authority, running status, saved location, etc.) ofan application or operation status corresponding to the selected iconcan be displayed [not shown in the drawing].

FIGS. 6A to 6C are diagrams for another example of inputting a 1^(st)touch and a 2^(nd) touch in a mobile terminal according to oneembodiment of the present invention.

As mentioned in the foregoing description, a predetermined pattern of a2^(nd) touch may be equal to or different from a pattern for turning ona touchscreen or cancelling a lock screen. And, the different case isdescribed with reference to FIG. 6.

Referring to FIG. 6A, while a touchscreen 151 is turned off, if 4 pointsare touched in a predetermined sequence (e.g., 1 to 4), a lock screen isunlocked as soon as the touchscreen 151 is turned on. In this case, the4 points marked with numerals are provided to help the understanding ofthis example but are not actually displayed on the touchscreen. And, itis a matter of course that the sequence, locations and number of thepoints can be changed.

On the other hand, a pattern for displaying a currently connectedwearable device can be configured different from that of a touchsequence and points for turning on a touchscreen. For instance, while atouchscreen is turned off, if touch inputs to 4 points in order of thenumeral sequence is detected [FIG. 6B], the controller can displayinformation of a currently connected wearable device in a manner similarto that shown in FIG. 5 (c).

Of course, referring to FIG. 6C, while a touched state (i.e., 1^(st)touch) of a random point on a touchscreen is maintained if a touch(i.e., 2^(nd) touch) is inputted in the same pattern shown in FIG. 6A,information of a wearable device can be displayed.

FIGS. 7A and 7B are diagrams for one example of a method of inputting acommand for displaying an information of a connected wearable device ona mobile terminal according to one embodiment of the present invention.

Referring to FIG. 7A, without discriminating a 1^(st) touch and a 2^(nd)touch from each other, while the touchscreen 151 is turned off, if atouch input applied in a manner of being dragged from a touchscreen topend to a touchscreen bottom end is detected, the controller 180 turns onthe touchscreen 151 and is able to control information of a currentlyconnected wearable device to be displayed through the touchscreen 151.Of course, such a drag touch input can start from a case edge (i.e.,bezel) of the touchscreen top end.

On the other hand, referring to FIG. 7B, while a user wears a wearabledevice 200, if the touchscreen 151 is turned on, the controller 180determines whether the user wears the wearable device. If the controller180 determines that the user currently wears the wearable device, thecontroller 180 can control an icon 710, which corresponds to thewearable device, to be displayed on a screen (e.g., a home screen, etc.)during a prescribed time. If the icon 710 is selected through a touchinput before disappearing, the controller 180 can control an informationof a currently connected wearable device to be displayed. Of course,while the corresponding icon 710 is displayed, if specific hardware keybutton(s) is manipulated, the controller 180 can control an informationof a currently connected wearable device to be displayed. Moreover,after the touchscreen has been turned on, only if a specific screen(e.g., a home screen) is displayed, the icon 710 can be displayed.Alternatively, the icon may be displayed irrespective of contentsdisplayed on the touchscreen that is turned on.

A display configuration depending on a type of a wearable device isdescribed in detail with reference to FIGS. 8A to 8C as follows.

FIGS. 8A to 8C are diagrams for one example of a configuration ofdisplaying an information of a wearable device in accordance with a typeof the wearable device on a mobile terminal according to one embodimentof the present invention.

In FIGS. 8A to 8C, assume that a command for displaying information of aconnected wearable device has been inputted by one of the former methodsdescribed with reference to FIGS. 5A to 7B.

Referring to FIG. 8A, in case that a wearable device is a watch type200, information of the wearable device can be displayed withinsilhouette of a watch shape 810.

Referring to FIG. 8B, in case that a wearable device is a necklace type200′, information of the wearable device can be displayed withinsilhouette of a necklace shape 820.

Referring to FIG. 8C, in case that a wearable device is a glasses type200″, information of the wearable device can be displayed withinsilhouette of a glasses shape 830.

In the following description, when a plurality of wearable devices arecurrently connected to a mobile terminal, a display configuration and aselecting method are explained with reference to FIGS. 9A to 9E.

FIGS. 9A and 9B are diagrams for one example of a configuration ofdisplaying an information of a wearable device on a mobile terminalconnected to a plurality of wearable devices according to one embodimentof the present invention.

In FIG. 9A, while a wearable device of a watch type, a wearable deviceof a necklace type and a wearable device of a glasses type are connectedto a mobile terminal, assume that a command for displaying informationof the wearable device is inputted.

Referring to FIG. 9A, an information 910 of the watch type wearabledevice is displayed in the middle part of the touchscreen 151. Aninformation 920 of the necklace type wearable device is displayed abovethe information 910 of the watch type wearable device. And, aninformation 930 of the glasses type wearable device is displayed belowthe information 910 of the watch type wearable device. In this case, theorder of arrangement of the devices can be determined in a manner that apreviously/last used/connected device is arranged in the middle. Inparticular, FIG. 9A shows a case that the watch type wearable device isconnected or used last. Alternatively, the order of arrangement of thewearable devices may follow the order preset by a user. Alternatively, acurrently put-on wearable device can be displayed in the middle of thetouchscreen 151.

In doing so, if a user inputs a drag or flicking touch in an arrowdirection (e.g., top direction) with a pointer, referring to FIG. 9B, arotation occurs in the top direction so that the glasses type wearabledevice 930 can be displayed in the middle.

FIGS. 9C to 9E are diagrams for one example of a process for installingan application by selecting a prescribed wearable device from aplurality of wearable devices connected to a mobile terminal accordingto one embodiment of the present invention.

Referring to FIG. 9C, in the former situation shown in FIG. 9A, if anicon 911 corresponding to a specific application is selected frominformation of a watch type wearable device through a touch input (e.g.,a long touch) of a preset type [FIG. 9C], all wearable devices can bedisplayed on a single screen by zooming out from a screen [FIG. 9D]. Indoing so, the corresponding icon enters a movable state 911′ tocorrespond to a point of a touch with a pointer. If the correspondingicon is dragged to a region for displaying an information 930 of aglasses type wearable device and then released from the touch, anapplication corresponding to the icon can start to be installed on theglasses type wearable device. Hence, referring to FIG. 9E, an icon 934corresponding to the application is created from the region fordisplaying the information 930 of the glasses type wearable device andan installation progress state 940 can be displayed.

In doing so, in order to install an application, an applicationinstallation file is extracted from a device having the correspondingapplication installed thereon and then forwarded to a target device.Alternatively, an installable address (e.g., URL) or an identificationinformation of an application providing service can be forwarded to thetarget device only. Of course, if a direct inter-wearable devicecommunication is not supported, the mobile terminal 100 can relay thecorresponding information.

In the following description, a process for installing an application,which is already installed on a mobile terminal, on a wearable device isdescribed in detail with reference to FIG. 10A and FIG. 10B.

FIG. 10A to 10G are diagrams for examples of installing an applicationinstalled on a mobile terminal on a wearable device connected to themobile terminal according to one embodiment of the present invention.

Referring to FIG. 10A, in the former situation shown in FIG. 9A, if aregion having no icons displayed thereon is selected from a region fordisplaying an information 910 of a watch type wearable device through atouch input (e.g., a long touch) of a preset type [FIG. 10A], allwearable devices can be displayed on a single screen by zooming out froma screen [FIG. 10B]. In doing so, icons corresponding to applicationsinstallable on a wearable device among all the applications installed onthe mobile terminal can be displayed on a right region 1010 of a screen.In this case, the right region 1010 can be scrolled in top-bottom and/orright-left direction so as to display other icons failing to bedisplayed thereon. In this case, if a user intends to install a specificapplication on the watch type wearable device, the user can drag an icon1011 corresponding to the specific application to the region fordisplaying the information 910 of the watch type wearable device.

Hence, an installation progress diagram can be displayed as soon as theinstallation starts [FIG. 10C]. If the installation is complete, an icon915 corresponding to the installed application can be added to theregion for displaying the information 910 of the watch type wearabledevice [FIG. 10D].

If the wearable device is short of storage space, a popup window 1020indicating the shortage can be displayed [FIG. 10E]. If a user selects‘delete’, a delete indicator 1030 can be displayed adjacent to each iconin the region for displaying the information of the watch type wearabledevice [FIG. 10F]. An application corresponding to the icon having itsdelete indicator selected can be removed from the corresponding device.Alternatively, a trash icon 1040 can be displayed instead of the deleteindicator [FIG. 10G]. Moreover, a user can delete an application in amanner of dragging an icon corresponding to a deletion-desiredapplication to the trash icon 1040.

Meanwhile, there may exist an application that cannot be installed inaccordance with a configuration of settings of a wearable device. Amethod of indicating that an application is not installable is describedin detail with reference to FIG. 11 as follows.

FIGS. 11A and 11B are diagrams for one example of a method of displayingpossibility in installing an application per wearable device in a mobileterminal according to one embodiment of the present invention.

Referring to FIG. 11A, different visual effects can be given to iconscorresponding to applications installable on another wearable device andicons corresponding to applications not installable on another wearabledevice, respectively. In the example shown in FIG. 11A, an application E1114 in an information 1110 of a necklace type wearable device isinstallable on another device only. Application A 1121, application Z1122 and application D 1124 in an information 1120 of a watch typewearable device are installable on another device only. And, anapplication A 1131 in an information 130 of a glasses type wearabledevice is installable on another device only. Besides, in the zoom-outstate shown in FIG. 10B, whether an application of a mobile terminal isinstallable on another device can be displayed on a prescribed region inaccordance with settings [not shown in the drawing].

If an icon 1122 corresponding to a specific application is selected fromthe information 1120 of the watch type wearable device by a long touchor the like, referring to FIG. 11B, a movable state 1122′ can beentered. In doing so, if the application corresponding to the selectedicon is not installable on the necklace type wearable device, a region1110′ for displaying the information of the necklace type wearabledevice can be displayed dark.

FIGS. 12A to 12D is a diagram for one example of a process for selectinga prescribed wearable device from a plurality of wearable devicesconnected to a mobile terminal and then installing an applicationinstalled on the selected wearable device on the mobile terminalaccording to one embodiment of the present invention.

Referring to FIG. 12, in the former situation shown in FIG. 9A, if anicon 911 corresponding to a specific application is selected frominformation of a watch type wearable device through a touch input (e.g.,a long touch) of a preset type [FIG. 12A], all wearable devices can bedisplayed on a single screen by zooming out from a screen [FIG. 12B]. Indoing so, the corresponding icon enters a movable state 911′ tocorrespond to a point of a touch with a pointer. If the correspondingicon is dragged to a right edge of a screen, a list of applicationsinstalled on the mobile terminal is displayed on a right region 1210[FIG. 12C]. In doing so, if the icon 911″ in the movable state has beenmoved into the right region 1210 and then released from the touch, anicon 1220 corresponding to the application is created as soon asinstallation starts. And, an installation progress diagram 1230 can bedisplayed [FIG. 12D].

FIGS. 13A to 13D are diagrams for another example of a process forinstalling an application installed on a mobile terminal on a prescribedone of a plurality of wearable devices connected to the mobile terminalaccording to one embodiment of the present invention.

Referring to FIG. 13A, in the former situation shown in FIG. 9A, if adrag/flicking touch is inputted in a lateral direction, a scroll isgenerated in the corresponding direction and a list of applicationsinstalled on a mobile terminal can be displayed [FIG. 13B]. In doing so,if a user drags an icon 1310 corresponding to an installation-desiredapplication to a screen edge, informations of all connected wearabledevices can be displayed by zoom-out [FIG. 13C]. In this case, if theuser cancels the touch from a region for displaying the information 930′of a glasses type wearable device, referring to FIG. 13D, theinformation 930 of the glasses type wearable device is displayed on ascreen center and an installation of the installation-desiredapplication can start. Hence, an icon 1310″ corresponding to theinstallation-desired application can be created and an installationprogress can be displayed as well.

In the following description, synchronization of application informationis explained in detail with reference to FIG. 14.

FIGS. 14A to 14C are diagrams for one example of a method of performingsynchronization of applications installed on a connected wearable devicein a mobile terminal according to one embodiment of the presentinvention.

Referring to FIG. 14A, informations 1410, 1420 and 1430 of connectedwearable devices are displayed. In doing so, if there is an applicationavailable for synchronization between the wearable devices, asynchronization icon 1440 can be displayed.

Referring to FIG. 14B, if the synchronization icon 1440 is selected,different visual effects 1460 and 1470 can be given to iconscorresponding to the synchronization available applications,respectively. And, a cancel icon 1450 for cancelling this state can bedisplayed. If the synchronization icon 1440 is selected one more time,synchronization of all the synchronization available applications can beperformed. In case that a user intends to select whether to perform thesynchronization per application, the per-application synchronization canbe performed in a manner of touching the visual effect 1470 displayed onthe icon 1421 corresponding to a synchronization desired application[FIG. 14C].

Meanwhile, according to another embodiment of the present invention,various kinds of convenient functions can be provided by the mobileterminal through the interworking with a put-on wearable device.

FIGS. 15A to 15G are diagrams for examples of a method of checking anevent occurring in the course of wearing a wearable device in a mobileterminal according to another embodiment of the present invention.

Referring to FIG. 15A, an event of receiving a text occurs in a watchtype wearable device 200 [FIG. 15A]. If a user knocks on a touch screen151 in a turned-off state twice by wearing the wearable device in aprescribed time from the event occurrence [FIG. 15B], a popup window1510 for confirming whether to check a message arriving at the wearabledevice through a mobile terminal can be displayed on a screen (e.g.,home screen) as soon as the touchscreen 151 is turned on [FIG. 15C].Thereafter, if the popup window 1510 is touched or a random region ofthe touchscreen 151 is touched twice again [i.e., knock on], the messagearriving at the wearable device can be displayed through the touchscreen151 of the mobile terminal [FIG. 15D]. In some cases, the step shown inFIG. 15A (c) can be omitted.

Referring to FIG. 15E, instead of the knock-on scheme described withreference to FIG. 15B, if a user makes a gesture of lifting up themobile terminal 100 in a prescribed time from the occurrence of an eventof receiving a text in a watch type wearable device 200 [FIG. 15E], thereceived text can be displayed like the example shown in FIG. 15D assoon as a touchscreen is turned on. In doing so, the controller 180 candetermine a type of the gesture through a gyro sensor, an accelerationsensor or the like.

In case that a plurality of events occur, the events can be displayed asa list 1520 on the touchscreen 151 [FIG. 15F]. If a specific item isselected from the list 1520, a detailed information of the correspondingitem can be displayed. If a lock screen is set in the mobile terminal,an indicator 1530 indicating an event occurrence can be displayed ondisplayed on the lock screen [FIG. 15G]. If the lock screen is unlocked,details of the corresponding event can be displayed.

The text message receptions shown in FIGS. 15A to 15G are examples ofevents, by which the present invention is non-limited. For instance, thepresent invention is applicable to various events including an alarmgeneration and the like.

Meanwhile, most of people desire to remember many things whileexercising. The things may include a record for health, a memory ofremembrance to recall that time and the like. Such things may not berecorded through one kind of a wearable device. And, it may be difficultto check the things through one kind of a wearable device. Therefore,the present embodiment can provide a solution for instantly checking allmemories by collecting them into one place. Generally, a wearable devicehas information on a timing point at which the wearable device is puton. It is preferable to use a wearable device for the purpose ofobtaining information recognized through a sensor due to a batteryproblem. A mobile terminal provides a relatively large display and ispreferably configured to display informations obtained from wearabledevices by integrating the obtained informations together owing to itsoperation capability. This is described in detail with reference toFIGS. 16A to 16D as follows.

FIGS. 16A to 16D are diagrams for one example of a method of displayingand utilizing data acquired from a plurality of wearable devicestogether in a mobile terminal according to another embodiment of thepresent invention.

Referring to FIG. 16A, a user exercises while wearing a glasses typewearable device 200″ and a watch type wearable device 200 together. Indoing so, a video can be taken in the glasses type wearable device 200″while a user's heartbeat rate and moving path can be obtained by thewatch type wearable device 200. If the controller 180 determines a casethat a moving speed is reduced due to a user's walking stop or the likeor a case that the user makes a gesture of lifting up the mobileterminal using the information obtained through the position locationmodule 15 or the sensing unit 140, the controller 180 can display theinformations obtained from the respective wearable devices together. Forinstance, referring to FIG. 16B, the video taken through the glassestype wearable device 200″ in the course of exercising is displayed on atop part 1610 of the touchscreen 151 and the path and heartbeat rateinformation obtained through the watch type wearable device 200 can bedisplayed on a region 1620 below the top part 1610.

In doing so, if a region 1621 for displaying the moving path informationis selected [FIG. 16C], a detailed moving path information can bedisplayed as a full screen and thumbnails 1631, 1632 and 1633 of videostaken on the path can be displayed to correspond to the video-takenlocations [FIG. 16D].

FIGS. 17A to 17C are diagrams for one example of a method of checkingdata acquired from a wearable device according to another embodiment ofthe present invention.

Referring to FIGS. 17A to 17C, while such a default information as awatch is displayed on a watch type wearable device in the course ofexercising, if a user stops exercising and makes a gesture of lifting upthe watch type wearable device, a heartbeat rate information can bedisplayed on a touchscreen of the watch type wearable device [FIG. 17A]. After the exercising, if the user makes a gesture of lifting up amobile terminal 100 [FIG. 17B], health related information collectedduring the exercising can be displayed together [FIG. 17 C].

FIGS. 18A to 18D are diagrams for one example of a method of checkingdata acquired from one wearable device in another wearable deviceaccording to another embodiment of the present invention.

In FIGS. 18A to 18D, assume a situation right after taking a photothrough a glasses type wearable device.

Referring to FIG. 18A, if a user makes a gesture of lifting up a mobileterminal 100 right after photographing or within a predetermined time, atouchscreen is automatically turned on and a photo taken through aglasses type wearable device can be directly displayed on thetouchscreen. If a lock screen is set, the taken image can be displayedon the lock screen.

If the user makes a gesture of lifting up a watch type wearable devicein a predetermined time from photographing, an icon 1810 indicating thata photo check is possible can be displayed on the watch type wearabledevice [FIG. 18B]. If the icon 1810 is selected, thumbnails of imagestaken through a glasses type wearable device can be displayed [FIG.18C]. If a specific thumbnail 1821 is selected from the displayedthumbnails, an image 1821′ corresponding to the selected thumbnail canbe displayed by being enlarged [FIG. 18D]. In doing so, if the usertouches the image 1821, a microphone of the watch type wearable devicecan be activated. And, a function (e.g., SNS transmission, etc.)corresponding to a voice command inputted through the microphone by theuser can be performed on the image.

Providing Linked Function Through Connection Between Wearable Device andExternal Display Device

Assume that an external display device mentioned in the followingdescription includes a digital signage. The digital signage (hereinafterabbreviated DS, for clarity) is an outdoor advertisement of digitalinformation using a display and means an advertisement panel capable ofcontrolling advertisement contents through a communication network by acontrol center. The digital signage (DS) can be frequently seen in sucha place having a large floating population as a subway station, a busstop, an apartment, an elevator, a back and the like. Generally, thedigital signage operates in a manner that advertisements in simple videoconfiguration with sound are alternately displayed per time slot. Yet,according to the present invention, the digital signage includes awireless communication unit and a touchscreen at least. And, assume thatthe digital signage can further include at least one modulecorresponding to each of the former modules shown in FIG. 1.

According to another embodiment of the present invention, a mobileterminal and controlling method thereof are provided, by which moreconvenient functions can be provided in a manner that the mobileterminal is connected to an external display device. In particular,according to the present embodiment, information on a wearable deviceput on by a user is displayed on an external display device orapplication management can be conducted by the external display device.And, information displayed through the external display device can betransferred to the wearable device.

The above description is explained in detail with reference to FIG. 19as follows.

FIG. 19 is a flowchart for one example of a process for performing alinked operation by connecting a wearable device and an external displaydevice to each other according to another embodiment of the presentinvention.

Referring to FIG. 19, first of all, network discovery and connection canbe performed [S1910]. For the present process, a DS side can alwaysactivate a wireless communication module (e.g., Bluetooth, Wi-Fi, etc.)in order for a wearable device to discover a DS. If the wearable devicesuccessfully discovers the DS, the wearable device finishes a prescribedinitial registration procedure with the DS in accordance with acorresponding communication protocol and is then able to establish adata path.

After a wireless data path has been established between the two devices,while a 1^(st) touch is inputted to a touchscreen of the DS and thenmaintained thereon without being cancelled, if a 2^(nd) touch isinputted [S1920], the controller 180 can control an information of atleast one currently connected wearable device to be displayed in aprescribed configuration [S1930].

In this case, the 1^(st) touch can be inputted to a random point on thetouchscreen. And, the 2^(nd) touch is preferably inputted in apredetermined pattern to a point different from the 1^(st) touchinputted point. of course, both of the 1^(st) touch and the 2^(nd) touchcan be simultaneously inputted or the 2^(nd) touch can be inputtedplural times within a prescribed time, depending on settings.

The currently connected wearable devices can be displayed as a list. Thecurrently connected wearable devices can be displayed in a manner thatvisual effects are given to the currently connected wearable devices tocorrespond to their shapes, respectively. An application installed oneach wearable device or a function executable through the installedapplication can be displayed together. If a plurality of the currentlyconnected wearable devices exist, a prescribed wearable device can beselected from the currently connected wearable devices.

Moreover, the displayed wearable device information is delivered to theDS after the data path establishment irrespective of a presence ornon-presence of the input of the 1^(st) touch/2^(nd) touch and can beupdated by real time or prescribed periods. Alternatively, the displayedwearable device information may be delivered to the DS from the wearabledevice when the 2^(nd) touch is inputted in the course of maintainingthe 1^(st) touch. The information of the wearable device may include atype of the wearable device, an information of an application installedon or currently running in the wearable device, an identificationinformation (e.g., phone number, email information, account information,user information, etc.) of the wearable device and the like.

Thereafter, various functions corresponding to a 3^(rd) touch inputtedto the touchscreen of the DS or control signals transmitted to the DSfrom the wearable device can be performed by the DS [S1940]. Informationaccording to the result from performing the function can be transmittedto the wearable device or may be managed by the DS only irrespective ofthe wearable device. The control signal transmitted to the DS from thewearable device may be attributed to a user's manipulation on thewearable device or may be automatically transmitted in accordance with adetermination made by the wearable device.

Meanwhile, if the 2^(nd) touch is not inputted in the course ofmaintaining the 1^(st) touch, as the 1^(st) touch is cancelled, afunction corresponding to the 1^(st) touch can be performed by the DS[S1950].

In the following description, a process for establishing a wireless datapath between a wearable device and a DS is explained in detail withreference to FIGS. 20A to 20D.

FIGS. 20A to 20D are diagrams for one example of a process forconnecting a wearable device and an external display device to eachother according to another embodiment of the present invention.

Referring to FIG. 20A, while a user wears a watch type wearable device200 and is located nearby a DS 300 including a touchscreen 351 (e.g., inthe coverage of a connection desired communication system such as BT andthe like), the user is able to page a wireless connection setting menuby manipulating the wearable device 200. Hence, referring to FIG. 20B, amenu 2020 for discovering adjacent Bluetooth devices can be displayed ona touchscreen 251 of the wearable device 200. In doing so, the hands ofa watch corresponding to a current hour (or numerals corresponding tothe current hour in case of indicating a time digitally) can bedisplayed on the touchscreen 251. And, a plurality of icons/indicators2011 can be displayed on the dial edges of the watch. Each of the iconsor indicators may correspond to a single application installed on thewearable device or an application group including a plurality ofapplications installed on the wearable device or may indicate anoperating state of the wearable device. The number of the displayedicons/indicators may follow a preset number according to a recently usedorder or a user-set priority or other icons/indicators can be displayedthrough a scroll. In the present specification, a configuration of eachof the icons or indicators is unified into a scheme of representingalphabet within a circle. If the alphabet is different, it may mean adifferent type of icon or indicator. If the alphabet is same, it maymean the same type. This is provided for clarity and convenience ofdescription only. Hence, it is apparent to those skilled in the art thatthe present invention is non-limited by the configurations and deployedpositions of the icons/indicators. Such idea can exactly apply to awearable device displayed on DS in the following description.

As the Bluetooth search is initiated, referring to FIG. 20C, a scanresult is displayed. If the user selects an item 2031 corresponding tothe nearby DS, a controller of the wearable device can establish a datapath with the DS by Bluetooth by controlling a wireless communicationmodule provided to the wearable device. As the data path establishmentis complete, a configuration 2040 corresponding to the DS can bedisplayed on the touchscreen 241 of the wearable device [FIG. 20D].

In the following description, a process for a connected DS to page aninformation of a wearable device is explained in detail with referenceto FIGS. 21A to 21D and FIG. 22. In FIGS. 21A to 21D and FIG. 22, assumea situation after the completion of establishment of a wireless datapath.

FIGS. 21A to 21D are diagrams for one example of a process fordisplaying information of a wearable device on an external displaydevice according to another embodiment of the present invention.

Referring to FIGS. 21A to 21D, while a random point on a touchscreen 351of a DS is touched with a single finger 2111, if the touchscreen 351 istouched with another finger 2112 [FIG. 21A], an information 2120 of awearable device can be displayed in a prescribed configuration [FIG.21B]. In this case, a detailed configuration of displaying theinformation of the wearable device shall be described later. In doingso, it is not necessary for the former finger 2111 to touch thetouchscreen 351 in the first place. Alternatively, both fingers cantouch the touchscreen 351 at the same time. If the touchscreen 351 istouched with the latter finger 2112 plural times in a prescribed time oronly if the time taken to maintain the touches with the two fingersexceeds a predetermined time, the wearable device may be displayed. Inthe situation shown in FIG. 21B, a 3^(rd) touch with a single finger2111 can be inputted. When the information of the wearable device isdisplayed, if a 2^(nd) touch is inputted while a 1^(st) touch ismaintained [FIG. 21C], a screen previous to displaying the informationof the wearable device can be displayed again [FIG. 21D].

In this case, when a data path with the wearable device is establishedonly, if the 1^(st) touch and the 2^(nd) touch are inputted in a presetpattern, the information of the wearable device can be displayedirrespective of the information displayed on the touchscreen of the DS.Of course, in accordance with settings, while a specific screen (e.g., ahomescreen of the DS, specific information or an execution screen of apre-authorized application for interworking with the wearable device) isdisplayed on the DS only, if the 1^(st) touch and the 2^(nd) touch areinputted in a preset pattern, the information of the wearable device canbe displayed.

FIG. 22 is a diagram for one example of a method of inputting a commandfor displaying information of a connected wearable device on an externaldisplay device according to another embodiment of the present invention.

Referring to FIG. 22, as a data path with the DS is established, aconfiguration 2040 corresponding to the DS can be displayed on atouchscreen of the wearable device 200. An icon 2210 corresponding tothe wearable device 200 can be displayed during a prescribed time (orcontinuously while connected) on a screen (e.g., home screen) displayedon the touchscreen 351 of the DS. If the icon 2210 is selected through atouch input before disappearing, the information of the connectedwearable device can be displayed on the touchscreen 351 of the DS.

In the following description, a display configuration depending on atype of a wearable device is explained in detail with reference to FIG.23 as follows.

FIG. 23 is a diagram for one example of a configuration of displaying aninformation of a wearable device in accordance with a type of thewearable device on an external display device according to oneembodiment of the present invention.

In FIGS. 23A to 23C, assume that a command for displaying information ofa connected wearable device has been inputted by one of the formermethods described with reference to FIGS. 21A to 21D and FIG. 22.

Referring to FIG. 23A, in case that a wearable device is a watch type200, information of the wearable device can be displayed withinsilhouette of a watch shape 2310.

Referring to FIG. 23B, in case that a wearable device is a necklace type200′, information of the wearable device can be displayed withinsilhouette of a necklace shape 2320.

Referring to FIG. 23C, in case that a wearable device is a glasses type200″, information of the wearable device can be displayed withinsilhouette of a glasses shape 2330.

Meanwhile, a list (i.e., use history) of recently used functions can bedisplayed on a silhouette top region 2340 of the wearable device. Inthis case, the recently used functions may include the functions used bythe wearable device before connection to the DS or the functionsdisplayed/executed on the touchscreen of the DS through the connectionto the DS. Each item in the list may have a thumbnail configurationcorresponding to an activated image of the corresponding function. And,each item in the list may include one of a name of the correspondingfunction, a status of the corresponding function, an icon of thecorresponding function, and a combination thereof. And, the meanings ofthe circular icons deployed within the silhouette as the same asmentioned in the foregoing description. If the information of theconnected wearable device displayed through the 1^(st) touch and the2^(nd) touch is displayed to correspond to a shape of the correspondingdevice, it can facilitate the visual discrimination of devices. And, itis unnecessary for the information of the wearable device to correspondto the shape. Meanwhile, if a specific icon is selected, a detailedinformation (e.g., an active screen, size, origin, authority, activestate, storage location, etc.) of an application or operating statuscorresponding to the selected icon can be displayed [not shown in thedrawing].

In the following description, when a plurality of wearable devices arecurrently connected to an external display device, a displayconfiguration and a selecting method are explained with reference toFIGS. 24A and 24B.

FIGS. 24A and 24B are diagrams for one example of a configuration ofdisplaying an information of a wearable device on an external displaydevice connected to a plurality of wearable devices according to oneembodiment of the present invention.

In FIGS. 24A and 24B, while a wearable device of a watch type, awearable device of a necklace type and a wearable device of a glassestype are connected to a DS, assume that a command for displayinginformation of the wearable device is inputted to the DS.

Referring to FIG. 24A, an information 2410 of the watch type wearabledevice is displayed in the middle part of the touchscreen 351 of the DS.An information 2420 of the necklace type wearable device is displayedabove the information 2410 of the watch type wearable device. And, aninformation 2430 of the glasses type wearable device is displayed belowthe information 2410 of the watch type wearable device. In this case,the order of arrangement of the devices can be determined in a mannerthat a previously/last used/connected device is arranged in the middle.In particular, FIG. 24A (a) shows a case that the watch type wearabledevice is connected or used last. Alternatively, the order ofarrangement of the wearable devices may follow the order preset by auser. Alternatively, a currently put-on wearable device can be displayedin the middle of the touchscreen 151.

In doing so, if a user inputs a drag or flicking touch in an arrowdirection (e.g., top direction) with a pointer, referring to FIG. 24B, ascroll is generated in the top direction so that the glasses typewearable device 2430 can be displayed in the middle.

In the following description, methods of managing information such as anapplication, a file and the like between wearable devices or between awearable device and a DS are explained in detail with reference to FIGS.24C to 26D. For clarity, assume that a target of management is anapplication. In this case, the management may include a process forinstalling an application, which is installed on a DS, on a connectedwearable device, a process for installing an application, which isinstalled on a connected wearable device, on a DS, or a process forinstalling an application, which is installed on one wearable device, onanother wearable device. Moreover, in case that the same application isinstalled on at least two of wearable devices currently connected to aDS, synchronization of application data may be included in themanagement of the present embodiment. Of course, if a content is notlimited to an application, it is a matter of course that installation ofan application can be substituted with a transfer/copy of a file orinformation item.

FIGS. 24C to 24E are diagrams for one example of a process for selectinga prescribed wearable device from a plurality of wearable devicesconnected to an external display device and then installing anapplication on the selected wearable device in the external displaydevice according to one embodiment of the present invention.

Referring to FIGS. 24C to 24E, in the former situation shown in FIG.24A, if an icon 2411 corresponding to a specific application is selectedfrom information of a watch type wearable device through a touch input(e.g., a long touch) of a preset type [FIG. 24C], all wearable devicesconnected to a DS can be displayed on a single screen by zooming outfrom a screen [FIG. 24D]. In doing so, the corresponding icon enters amovable state 2411′ to correspond to a point of a touch with a pointer.If the corresponding icon is dragged to a region for displaying aninformation 2430 of a glasses type wearable device and then releasedfrom the touch, an application corresponding to the icon can start to beinstalled on the glasses type wearable device. Hence, referring to FIG.24E, an icon 2434 corresponding to the application is created from theregion for displaying the information 2430 of the glasses type wearabledevice and an installation progress state 2440 can be displayed.

In doing so, in order to install an application, an applicationinstallation file is extracted from a device having the correspondingapplication installed thereon and then forwarded to an installationtarget device. Alternatively, an installable address (e.g., URL) or anidentification information of an application providing service can beforwarded to the target device only. Of course, if a directinter-wearable device communication is not supported, the DS can relaythe corresponding information.

In the following description, a process for installing an application,which is already installed on a DS, on a wearable device is described indetail with reference to FIGS. 25A to 25G.

FIGS. 25A to 25G are diagrams for examples of installing an application,which is installed on an external display device, on a wearable deviceconnected to the external display device according to one embodiment ofthe present invention.

Referring to FIGS. 25A to 25D, in the former situation shown in FIG.24A, if a region having no icons displayed thereon is selected from aregion for displaying an information 2410 of a watch type wearabledevice through a touch input (e.g., a long touch) of a preset type [FIG.25A], all wearable devices can be displayed on a single screen byzooming out from a screen [FIG. 25B]. In doing so, icons correspondingto applications installable on a wearable device among all theapplications installed on a DS can be displayed on a right region 2510of a screen. In this case, the right region 2510 can be scrolled intop-bottom and/or right-left direction so as to display other iconsfailing to be displayed thereon. In this case, if a user intends toinstall a specific application on the watch type wearable device, theuser can drag an icon 2511 corresponding to the specific application tothe region for displaying the information 2410 of the watch typewearable device.

Hence, an installation progress diagram can be displayed as soon as theinstallation starts [FIG. 25C]. If the installation is complete, an icon2415 corresponding to the installed application can be added to theregion for displaying the information 2410 of the watch type wearabledevice [FIG. 25D].

If the wearable device is short of storage space, a popup window 2520indicating the shortage can be displayed [FIG. 25E]. If a user selects‘delete’, a delete indicator 2530 can be displayed adjacent to each iconin the region for displaying the information of the watch type wearabledevice [FIG. 25F]. An application corresponding to the icon having itsdelete indicator selected can be removed from the corresponding device.Alternatively, a trash icon 2540 can be displayed instead of the deleteindicator [FIG. 25G]. Moreover, a user can delete an application in amanner of dragging an icon corresponding to a deletion-desiredapplication to the trash icon 2540.

FIGS. 26A to 26D are diagrams for another example of a process forinstalling an application, which is already installed on a mobileterminal, on a prescribed one of wearable devices connected to anexternal display device according to another embodiment of the presentinvention.

Referring to FIGS. 26A to 26D, in the former situation shown in FIG. 24A(a), if a drag/flicking touch is inputted in a lateral direction [FIG.26A], a scroll is generated in the corresponding direction and a list ofapplications installed on a DS can be displayed [FIG. 26B]. In doing so,if a user drags an icon 2610 corresponding to an installation-desiredapplication to a screen edge, informations of all connected wearabledevices can be displayed by zoom-out [FIG. 26C]. In this case, if theuser cancels the touch from a region for displaying the information2430′ of a glasses type wearable device, referring to FIG. 26D, theinformation 2430 of the glasses type wearable device is displayed on ascreen center and an installation of the installation-desiredapplication can start. Hence, an icon 2610″ corresponding to theinstallation-desired application can be created and an installationprogress can be displayed as well.

Each of the screens shown in FIGS. 24A to 26D is displayed as a fullscreen on the touchscreen 351 of the DS, by which the present inventionis non-limited. And, it is apparent to those skilled in the art thateach of the screens shown in FIGS. 24A to 26D can be displayed on apartial region of the touchscreen 351. For instance, each of the screensmay be displayed on a region of the touchscreen 351 except the topregion 2340 of the touchscreen 351 in the situation shown in FIGS. 23Ato 23C and can be arranged to be scrollable not in portrait directionbut in landscape direction.

In the following description, how to update a use history is explainedin detail with reference to FIGS. 27A to 27C.

FIGS. 27A to 27C are diagrams for one example of a process for updatinguse history of a wearable device through an external display deviceaccording to another embodiment of the present invention.

Referring to FIG. 27A, after a wearable device has been selected, if auser selects a prescribed icon from a plurality of icons displayed onthe touchscreen 351 of the DS, an information corresponding to theselected icon can be displayed as shown in FIG. 27B. In doing so, if theuser inputs a command for paging information of the wearable device, theinformation corresponding to the selected icon can be delivered to thewearable device. Hence, referring to FIG. 27C, a correspondinginformation 2710 can be displayed as an initial item of a use history.And, a previous item A can be pushed to a right side.

FIGS. 28A to 28D are diagrams for one example of a process for checkinginformation of a wearable device in an external display device and thenupdating a use history in accordance with the checked informationaccording to another embodiment of the present invention.

Referring to FIG. 28A, in a situation that information of a wearabledevice is displayed through the touchscreen 351 of the DS, a galleryicon 2814 displayed in a silhouette 2810 of the wearable device can beselected. Hence, referring to FIG. 28B, thumbnails of images saved inthe wearable device can be displayed on the touchscreen 351 of the DS.In doing so, if a specific thumbnail 2831 is selected, referring to FIG.28C, a corresponding image 2831′ can be displayed as a full screen. Indoing so, if a command for returning to the information of the wearabledevice is inputted, referring to FIG. 28D, an item 2823 corresponding tothe image displayed as the full screen can be displayed on a use historyof a top region 2820 in the first place.

In the following description, an interworking situation between anexternal display device and a wearable device is explained in detailwith reference to FIGS. 29A to 29D and FIGS. 30A to 30D.

FIGS. 29A to 29D are diagrams for one example of a method of directlydisplaying a function executed in a wearable device on an externaldisplay device according to another embodiment of the present invention.

Referring to FIG. 29A, as a connection to the DS is completed, asilhouette 2040 of the DS can be displayed on the touchscreen 351 of thewearable device. In doing so, if a user selects a gallery icon 2910 fromthe wearable device, referring to FIG. 29B, a specific image can bedisplayed. In doing so, if the user inputs a 1^(st) touch and a 2^(nd)touch to the connected DS with a pointer 2920 [FIG. 29C], a specificimage can be directly displayed as the information of the wearabledevice [FIG. 29D].

FIGS. 30A to 30D are diagrams for one example of a method of displayinga function executed in an external display device on a wearable deviceaccording to another embodiment of the present invention. Assume thatthe process shown in FIGS. 30A to 30D follows the former process shownin FIGS. 29A to 29D.

Referring to FIGS. 30A to 30D, if a command (e.g., a flicking in leftdirection, etc.) for returning to a previous screen is inputted to thetouchscreen of the DS through a pointer 3010 [FIG. 30A], a thumbnaillist can be displayed [FIG. 30B]. Thereafter, if a user checks thewearable device [FIG. 30C], a change of a job occurring in the DS isidentically applied to the wearable device so that a screencorresponding to FIG. 30A can be changed into a screen corresponding toFIG. 30B [FIG. 30D].

FIGS. 31A to 31D and FIGS. 32A to 32D are diagrams for one example of aprocess for transmitting information displayed on an external displaydevice to a wearable device according to another embodiment of thepresent invention.

Referring to FIGS. 31A to 31D and FIGS. 32A to 32D, after a wearabledevice and a DS have been connected to each other, if a zoom-out touchis inputted to the touchscreen of the DS in order to pinch in two touchpoints [FIG. 31A], a screen 3110 displayed on the DS is reduced and awatch silhouette 3120 including information of the wearable device canbe displayed on a vacant space together [FIG. 31B]. In doing so, if auser selects a specific icon from the reduced DS screen 3110, referringto FIG. 31C, an information 3110′ corresponding to the selected icon canbe displayed on the reduced DS screen. In this case, if the user dragsthe information 3110′ displayed on the reduced DS screen to the watchsilhouette 3120, referring to FIG. 31D, the corresponding information istransmitted to the wearable device and a corresponding information 3120′can be displayed within the watch silhouette. In this case, if the userinputs a zoom-in touch [FIG. 32A], the DS screen can return to the fullscreen [FIG. 32B]. Moreover, if a watch silhouette 3120′ is touched(e.g., a long touch, a double touch, etc.) [FIG. 32C], the watchsilhouette can be displayed as a full screen [FIG. 32D].

FIG. 33 is a diagram for one example of a method of transmitting acoupon according to another embodiment of the present invention.

Referring to FIGS. 33A and 33B, a list of menus provided by the DS isdisplayed through the touchscreen 351 of the DS [FIG. 33A]. In thiscase, if there is a coupon provided through the DS in each item, couponindicators 3311 and 3322 can be displayed next to the correspondingitems, respectively. In case of a new coupon 3311, an alphabet ‘N’ canbe included in the corresponding indicator in order to indicate the newcoupon 3311. In case of a coupon 3322 of which validity expiration isimminent, alphabet ‘E’ can be included. Of course, the grant of alphabetis exemplary. And, it is a matter of course that a status of a couponcan be displayed in various ways. If a user selects an electronic deviceitem, a place for using the corresponding coupon can be displayed on amap [FIG. 33B]. In this case, if the user inputs a 1^(st) touch and a2^(nd) touch, information of a wearable device is displayed and thecorresponding coupon information can be transmitted to the wearabledevice as well.

FIGS. 34A to 34F are diagrams for one example of a method oftransmitting a coupon to another device according to another embodimentof the present invention.

Referring to FIGS. 34A to 34F, a user can select a write mode from themenu of DS in order to leave a coupon for a friend through the DS.Hence, a sub-menu of the write mode can be displayed [FIG. 34A]. Indoing so, if the user selects Coupon, a list of coupons, which can beprovided through the DS, can be displayed [FIG. 34B]. If the coupon isselected, a menu for selecting a transmission target can be displayed[FIG. 34C]. If Friend is selected, the DS makes a request for a friendlist (e.g., phonebook, mail address book, messenger address book, etc.)to a connected wearable device and then receives the friend list. The DScan display the received friend list [FIG. 34D]. If a friend is selectedfrom the friend list, a coupon transmission can be reserved in the DSthrough a final check [FIG. 34E. Thereafter, if a mobile terminal orwearable device having an identification information corresponding tothe selected friend is connected to the DS, the DS can control a message3420, which notifies a presence of a coupon reserved by the user to besent, to be displayed on a device 3410 of the selected friend [FIG.34F].

In the example shown in FIG. 34, the coupon is mentioned, by which thepresent invention is non-limited. For example, a photo, a voicerecording, a text or a combination thereof is saved in the DS byspecifying a recipient. If a device of the specified recipient isconnected to the DS, such information can be transmitted to thecorresponding device.

FIGS. 35A and 35B are diagrams for one example of a configuration ofdisplaying a visit history on an external display device according toanother embodiment of the present invention.

Referring to FIG. 35A, when a list of menus provided by the DS isdisplayed through the touchscreen 351 of the DS, if a visit history menuis selected, the DS makes a request for a moving path (GPS) informationto a wearable device and is then able to receive the correspondinginformation. Hence, referring to FIG. 35B, an area visited by a user canbe displayed on a DS-nearby map through an indicator 3510. Of course, alocation, from which the user downloads a coupon, can be displayedthrough an indicator as well as the directly visited location displayedon GPS. And, a recommended location set by a friend through a methodsimilar to that shown in FIGS. 34A and 34B can be displayed through anindicator 3520.

In the following description, a method of determining whether a wearabledevice is put on and a method of informing a user whether a wearabledevice is put on, which are applicable to embodiments of the presentinvention, are explained in detail with reference to FIGS. 36A to 36Dand FIGS. 37A to 37C.

FIGS. 36A to 36D are diagrams for one example of a method of determiningwhether a wearable device is put on, which is applicable to embodimentsof the present invention.

Referring to FIG. 36A, a wearing detecting means 3600 can be provided toa part (e.g., a backside of a body of a watch type 200, a backside of achain of a necklace type 200′, an inner lateral side of a glasses templeof a glasses type 200″, etc.) of each wearable device coming contactwith a human body. The wearing detecting means 3600 can employ acapacitive detection scheme, an optical detection scheme or the like. Inorder to enhance wearable comfort, the wearing detecting means 3600 caninclude a flexible material.

According to the capacitive detecting scheme, referring to FIG. 36B, aTx electrode 3620 and an Rx electrode 3630 are arranged on an electrodepad 3610 in a manner of being spaced apart from each other. And, adetecting unit 3640 can determine a capacitance change generated betweenthe electrodes when the pad 3610 comes in contact with a skin. Thearranged configuration of the electrodes can be variously modifiable ifnecessary [FIG. 36C].

According to the optical detection scheme, referring to FIG. 36D, alight receiving unit 3660 detects a change attributed to an effect thata light applied by a light emitting unit 3650 to an opening formed in apad 3610 is reflected by a skin, whereby a presence or non-presence ofwearing can be detected.

Anti-reflection coating can be applied to a light-passing path toprevent from being externally seen. And, a physical filter can beapplied to the light receiving unit 3660 to cut off influence of otherexternal lights.

In order to determine whether the light applied by the light emittingunit is reflected by the skin or another substance, the light emittingunit can emit light in specific pattern and light wavelengths can beimplemented diversely. In this case, the light receiving unit candetermine whether the light from the light emitting unit is reflected bythe skin more accurately by analyzing a pattern of a per-wavelengthincident reflective light for each wavelength.

In addition to the capacitive detection scheme and the optical detectionscheme, it is able to detect a presence or non-presence of wearing froma presence or non-presence of a user's motion. Information on thepresence or non-presence of the wearing determined by one of theabove-described schemes can be transmitted to a mobile terminal fromeach wearable device and can be also provided to a user visually throughthe mobile terminal or the wearable device. This is described in detailwith reference to FIG. 37 as follows.

FIGS. 37A to 37C are diagrams for one example of a method of informing auser whether a wearable device is put on, which is applicable toembodiments of the present invention.

Referring to FIG. 37A, a watch type wearable device 200 and a mobileterminal 100 are connected to each other but the watch type wearabledevice 200 is not put on.

Referring to FIG. 37B, if it is determined that a user wears the watchtype wearable device 200, a color of a background screen of atouchscreen 251 of the watch type wearable device 200 and a color of abackground screen of a touchscreen 151 of the mobile terminal 100 can bechanged for prescribed duration. And, an indicator 3710 indicating thatthe user wears the corresponding device can be displayed on a prescribedregion (e.g., a top indicator region, etc.) of each of the touchscreens.

Referring to FIG. 37C, after lapse of a prescribed time, the backgroundcolor change of each of the touchscreens can disappear. Moreover, theindicator 3710 shown in FIG. 37B disappears from the touchscreen 251 ofthe watch type wearable device 200 and a prescribed visual effect 3720can be given to the edge of the touchscreen 251.

Particularly, the presence or non-presence of the wearing described withreference to FIGS. 36A to 36D and FIGS. 37A to 37C can become theprecondition for FIG. 7B and FIGS. 15A to 18D.

In the following description, a basic assumption for a connection (e.g.,a paring, etc.) between a wearable device and a mobile terminal, whichis applicable to embodiments of the present invention, is explained.

According to the present invention, when a wearable device is put on ora power of the wearable device is turned on, the wearable device canautomatically attempt a reconnection with a previously paired device.And, the wearable device can output the success/failure depending on aresult of the attempt in various ways (e.g., visual information,vibration, audio, etc.). The reattempt of the pairing can be performedby shaking the wearable device, re-wearing the wearable device,resetting a power, or the like. If a pairing is disconnected due to aweak radio signal, a reconnection to the mobile terminal can bereattempted by predetermined time intervals. If the wearable device isnot put on, the reconnection may not be attempted in accordance withsettings.

Moreover, a wearable device paired with a mobile terminal canmanage/update connection information in flag state as shown in Table 1.

TABLE 1 Paring flag Wearing flag Remarks 1 0 Not wearing in wirelessconnected state 1 1 Wearing in wireless connected state 0 1 Wearing inwireless disconnected state

Meanwhile, it is a matter of course that the flag states shown in Table1 can be visually represented through indicators of the respectivedevices.

It will be apparent to those skilled in the art that variousmodifications and variations can be specified into other form(s) withoutdeparting from the spirit or scope of the inventions.

According to one embodiment of the present invention, theabove-described methods can be implemented in a program recorded mediumas computer-readable codes. The computer-readable media include allkinds of recording devices in which data readable by a computer aresaved. The computer-readable media include ROM, RAM, CD-ROM, magnetictapes, floppy discs, optical data storage devices, and the like forexample and also include carrier-wave type implementations (e.g.,transmission via Internet). Moreover, the computer may include acontroller 180 of a terminal.

The aforementioned embodiments are achieved by combination of structuralelements and features of the present invention in a predetermined type.Each of the structural elements or features should be consideredselectively unless specified separately. Each of the structural elementsor features may be carried out without being combined with otherstructural elements or features. Also, some structural elements and/orfeatures may be combined with one another to constitute the embodimentsof the present invention.

It will be apparent to those skilled in the art that variousmodifications and variations can be made in the present inventionwithout departing from the spirit or scope of the inventions. Thus, itis intended that the present invention covers the modifications andvariations of this invention provided they come within the scope of theappended claims and their equivalents.

What is claimed is:
 1. A mobile terminal comprising: a wirelesscommunication unit configured to communicate with at least one wearabledevice; a touchscreen configured to display information and to receivetouch inputs; and a controller configured to turn on the touchscreen andcause the touchscreen to display information of the at least onewearable device that is wirelessly connected with the mobile terminalvia the wireless communication unit in response to a first touch input,which is received via the touchscreen while the touchscreen is in aturned-off status, and a second touch input that is received via thetouchscreen while the first touch input is maintained on thetouchscreen.
 2. The mobile terminal of claim 1, wherein when a pluralityof wearable devices are wirelessly connected to the mobile terminal, thecontroller is further configured to arrange the information on thetouchscreen based on whether each the plurality of wearable devices isworn on a body part.
 3. The mobile terminal of claim 2, wherein thecontroller is further configured to cause the touchscreen to display theinformation of the plurality of wearable devices in a rotating manner inresponse to a scroll command received via the touchscreen such thatinformation of each of the plurality of wearable devices is displayedaccording to the rotation of the displayed information.
 4. The mobileterminal of claim 1, wherein the information of the at least onewearable device comprises information of at least one applicationinstalled in the at least one wearable device.
 5. The mobile terminal ofclaim 4, wherein: the information of the at least one wearable devicefurther comprises at least one graphic object representing at least onetype of the at least one wearable device; and at least one iconrepresenting the at least one application is enclosed within a boundaryof the at least one graphic object such that a plurality of graphicobjects are displayed on the touchscreen when a plurality of wearabledevices are wirelessly connected to the mobile terminal and a pluralityof icons are included within a boundary of a corresponding one of theplurality of graphic objects when a plurality of applications areinstalled in a corresponding one of the plurality of wearable devices.6. The mobile terminal of claim 5, wherein the controller is furtherconfigured to cause the touchscreen to display detailed information ofan application installed in the corresponding one of the plurality ofwearable devices in response to selection of an icon corresponding tothe application from among the plurality of icons included within theboundary of the corresponding one of the plurality of graphic objects.7. The mobile terminal of claim 5, wherein in response to selection of afirst icon corresponding to a first application installed in a firstwearable device among the plurality of wearable devices followed bymovement of the selected first icon to a first region of thetouchscreen, the controller is further configured to install the firstapplication in the mobile terminal or in at least one of the pluralityof wearable devices except for the first wearable device based on wherethe first region is located on the touchscreen.
 8. The mobile terminalof claim 7, wherein when the first region is located at an edge regionof the touchscreen, in response to the selection of the first icon andthe movement of the selected first icon to the first region, thecontroller is further configured to: cause the touchscreen to display,on a second region of the touchscreen, an icon corresponding to each ofat least one application installed in the mobile terminal, a boundary ofthe second region including the first region; install the firstapplication in the mobile terminal; and cause the touchscreen todisplay, on the second region of the touchscreen, an additional iconcorresponding to the first application when the installation of thefirst application in the mobile terminal starts or is completed.
 9. Themobile terminal of claim 5, wherein in response to selection of a firsticon corresponding to a first application installed in a first wearabledevice among the plurality of wearable devices followed by movement ofthe selected first icon to another region of the touchscreen, thecontroller is further configured to delete the first application fromthe first wearable device.
 10. The mobile terminal of claim 1, whereinthe controller is further configured to: determine whether the connectedat least one wearable device is on a body part; cause the touchscreen todisplay an icon indicating presence of the connected at least onewearable device on the body part; and cause the touchscreen to displaythe information of the connected at least one wearable device inresponse to selection of the icon.
 11. A method of controlling a mobileterminal comprising a touchscreen, the method comprising: communicatingwith at least one wearable device; and turning on the touchscreen anddisplaying information of the at least one wearable device that iswirelessly connected with the mobile terminal in response to a firsttouch input, which is received via the touchscreen while the touchscreenis in a turned-off status, and a second touch input that is received viathe touchscreen while the first touch input is maintained on thetouchscreen.
 12. The method of claim 11, wherein when a plurality ofwearable devices are wirelessly connected to the mobile terminal, themethod further comprises arranging the information on the touchscreenbased on whether each the plurality of wearable devices is worn on abody part.
 13. The method of claim 12, further comprising displaying theinformation of the plurality of wearable devices in a rotating manner inresponse to a scroll command received via the touchscreen such thatinformation of each of the plurality of wearable devices is displayedaccording to the rotation of the displayed information.
 14. The methodof claim 11, wherein the information of the at least one wearable devicecomprises an information of at least one application installed in the atleast one wearable device.
 15. The method of claim 14, wherein: theinformation of the at least one wearable device further comprises atleast one graphic object representing at least one type of the at leastone wearable device; and at least one icon representing the at least oneapplication is enclosed within a boundary of the at least one graphicobject such that a plurality of graphic objects are displayed on thetouchscreen when a plurality of wearable devices are wirelesslyconnected to the mobile terminal and a plurality of icons are includedwithin a boundary of a corresponding one of the plurality of graphicobjects when a plurality of applications are installed in acorresponding one of the plurality of wearable devices.
 16. The methodof claim 15, further comprising displaying detailed information of anapplication installed in the corresponding one of the plurality ofwearable devices in response to selection of an icon corresponding tothe application from among the plurality of icons included within theboundary of the corresponding one of the plurality of graphic objects.17. The method of claim 15, further comprising in response to selectionof a first icon corresponding to a first application installed in afirst wearable device among the plurality of wearable devices followedby movement of the selected first icon to a first region of thetouchscreen, installing the first application in the mobile terminal orin at least one of the plurality of wearable devices except for thefirst wearable device based on where the first region is located on thetouchscreen.
 18. The method of claim 17, wherein when the first regionis located at an edge region of the touchscreen, in response to theselection of the first icon and the movement of the selected first iconto the first region, the method further comprises: displaying, on asecond region of the touchscreen, an icon corresponding to each of atleast one application installed in the mobile terminal, a boundary ofthe second region including the first region; installing the firstapplication in the mobile terminal; and displaying, on the second regionof the touchscreen, an additional icon corresponding to the firstapplication when the installation of the first application in the mobileterminal starts or is completed.
 19. The method of claim 15, furthercomprising in response to selection of a first icon corresponding to afirst application installed in a first wearable device among theplurality of wearable devices followed by movement of the selected firsticon to another region of the touchscreen, deleting the firstapplication from the first wearable device.
 20. The method of claim 11,further comprising: determining whether the connected at least onewearable device is on a body part; displaying an icon indicatingpresence of the connected at least one wearable device on the body part;and displaying the information of the connected at least one wearabledevice in response to selection of the icon.